-- Logs begin at Thu 2022-08-18 15:53:08 UTC, end at Thu 2022-08-18 17:24:59 UTC. -- Aug 18 16:56:45.869746 dv-cinder-853678-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 16:56:45.878439 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 16:56:45 2022] *** Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: nodename: dv-cinder-853678-2-iscsi Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: machine: x86_64 Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: clock source: unix Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: pcre jit disabled Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: detected number of CPU cores: 4 Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: current working directory: / Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: detected binary path: /usr/bin/uwsgi-core Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: your processes number limit is 47680 Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: your memory page size is 4096 bytes Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: detected max file descriptor number: 2048 Aug 18 16:56:45.880436 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: lock engine: pthread robust mutexes Aug 18 16:56:45.883767 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: thunder lock: enabled Aug 18 16:56:45.883767 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 16:56:45.883767 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 16:56:45.922204 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: Python main interpreter initialized at 0x55a7cb0a49c0 Aug 18 16:56:45.922204 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: python threads support enabled Aug 18 16:56:45.922204 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: your server socket listen backlog is limited to 100 connections Aug 18 16:56:45.922204 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: your mercy for graceful operations on workers is 90 seconds Aug 18 16:56:45.922644 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 16:56:45.922644 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: *** Operational MODE: preforking *** Aug 18 16:56:45.923116 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: *** uWSGI is running in multiple interpreter mode *** Aug 18 16:56:45.923116 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: spawned uWSGI master process (pid: 106123) Aug 18 16:56:45.923109 dv-cinder-853678-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 16:56:45.925868 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: spawned uWSGI worker 1 (pid: 106134, cores: 1) Aug 18 16:56:45.925868 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: spawned uWSGI worker 2 (pid: 106135, cores: 1) Aug 18 16:56:45.925868 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 16:56:46.587755 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 16:56:46.604277 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 16:56:47.673008 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:56:47.673008 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: from cryptography.utils import int_from_bytes Aug 18 16:56:47.673731 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:56:47.673731 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: from cryptography.utils import int_from_bytes Aug 18 16:56:47.681691 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:56:47.681691 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: from cryptography.utils import int_from_bytes Aug 18 16:56:47.682133 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 16:56:47.682133 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: from cryptography.utils import int_from_bytes Aug 18 16:56:50.187308 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 16:56:50.187908 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 16:56:50.188265 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 16:56:50.188365 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 16:56:50.188454 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 16:56:50.188540 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 16:56:50.188540 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 16:56:50.188710 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 16:56:50.188800 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 16:56:50.188885 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 16:56:50.189047 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.189147 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.189366 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.189460 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.189682 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.189776 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.189994 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.190094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.190320 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.190443 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.190626 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.190755 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.190937 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.191043 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.191251 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.191343 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.191605 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.191713 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.191866 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.191959 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.192173 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.192264 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.192492 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853678-2-iscsi {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.192590 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853678-2-iscsi {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.192811 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.192901 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.193688 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.193793 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.194002 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.194100 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.194321 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.194430 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.194621 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.194713 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.194936 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.195030 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.195239 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.195335 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.195751 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.195866 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.196937 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197087 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197204 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197302 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197302 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197501 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197594 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197683 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197762 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197892 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.197981 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.198071 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.198151 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.198282 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.198373 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.198452 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.198575 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.198676 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.198878 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.198978 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.199271 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853678-2-iscsi {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.199359 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853678-2-iscsi {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.199624 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.199735 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.199929 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.200073 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.200342 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.200594 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.200712 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.200862 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.200956 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.201043 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.201246 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.201340 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.201532 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.201633 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.201847 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.201950 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.202146 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.202239 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.202466 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.202554 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.202780 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.202875 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.203096 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.203194 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.203412 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.203530 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.203738 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.203832 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.204043 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.204147 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.204350 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.204482 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.204665 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.204774 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.204966 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.205062 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.205263 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.205355 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.205510 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.205601 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.205809 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.205905 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.206124 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.206216 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.206437 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.206530 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.206751 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.206842 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.207000 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.207085 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.207243 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.207347 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.207577 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.207679 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.207892 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.207981 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.208195 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.208293 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.208497 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.208581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.208831 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.208933 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.209132 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.209215 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.209435 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.209510 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.209738 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.209819 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.210038 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.210227 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.210337 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.210420 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.210649 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.210724 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.210957 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.211095 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.211273 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.211366 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.211604 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.211737 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.211976 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.212093 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.212295 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.212439 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.212548 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.212663 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.212832 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.212946 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.213162 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.213290 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.213478 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.213599 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.213805 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.213906 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.214093 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.214193 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.214425 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.214563 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.214710 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.214791 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.215012 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.215095 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.215310 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.215458 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.215758 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.215858 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.216136 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.216273 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.216441 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.216694 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.216787 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.216997 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.217233 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.217328 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.217650 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.217786 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.217963 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.218270 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.218360 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.218576 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.218876 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.218976 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.219181 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.219518 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.219625 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.219829 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.220079 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.220168 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.220425 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.220662 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.220769 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.221024 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.221229 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.221326 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.221619 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.221791 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.221935 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.222253 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.222436 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.222560 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.222863 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.222954 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.223175 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.223503 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.223606 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.223825 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.224078 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.224174 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.224451 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.224684 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.224786 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.225063 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.225246 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.225367 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.225686 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.225792 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.225992 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.226298 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.226390 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.226616 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.226916 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.227010 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.227221 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.227538 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.227642 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.227860 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.228119 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.228219 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.228455 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.228693 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.228778 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.229047 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.229264 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.229360 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.229637 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.229834 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.229942 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.230241 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.230433 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.230558 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.230879 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.230998 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.231186 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.231515 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.231604 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.231823 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.232142 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.232229 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.232477 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.232724 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.232830 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.233142 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.233227 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.233457 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.233541 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.233789 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.234059 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.234304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.234391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.234636 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.234760 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.234958 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.235054 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.235279 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.235374 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.235639 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.235735 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.235954 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.236049 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.236261 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.236402 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.236568 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.236654 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.236876 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.236964 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.237181 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.237277 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.237486 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.237577 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.237790 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.237885 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.238094 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.238186 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.238394 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.238485 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.238710 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.238796 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.239025 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.239111 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.239332 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.239416 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.239663 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.239759 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.240509 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.240608 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.240829 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 16:56:50.240926 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.241168 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.241254 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.241481 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.241575 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.241809 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.241913 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.242129 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.242218 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.242445 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.242554 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.242751 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.242853 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.243059 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.243153 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.243374 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.243502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.243713 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.243817 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.244033 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.244118 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.244340 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.244425 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.244649 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.244745 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.244959 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.245049 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.245273 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.245375 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.245580 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.245681 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.245892 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.245988 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.246206 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.246297 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.246519 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.246619 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.246830 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.246914 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.247136 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.247279 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.247469 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.247589 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.247785 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.247871 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.248095 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.248180 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.248409 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.248498 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.248714 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.248809 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.249018 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.249113 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.249323 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.249418 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.249714 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.249817 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.249938 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.250035 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.250257 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.250344 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.250585 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.250685 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.250889 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.250988 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.251208 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.251340 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.251565 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.251678 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.251845 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.251942 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.252156 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.252250 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.252463 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.252547 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.252764 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.252861 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.253067 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.253162 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.253373 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.253464 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.253681 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.253768 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.254002 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.254095 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.254309 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.254392 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.254612 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.254699 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.254917 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.255055 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.255223 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.255315 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.255597 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.256218 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.256434 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.256521 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.256741 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.256838 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.257048 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.257143 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.257354 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.257447 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.257659 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.257752 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.257971 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.258058 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.258278 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.258365 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.258590 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.258684 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.258913 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.258998 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.259220 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.259307 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.259553 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.259654 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.259870 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.259956 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.260178 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.260272 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.260486 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.260585 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.260789 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.260873 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.261088 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.261173 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.261393 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.261491 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.261697 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.261787 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.261998 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.262084 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.262304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.262407 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.262605 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.262692 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.262903 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.262987 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.263203 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.263302 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.263528 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.263619 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.263838 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.263935 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.264145 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.264233 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.264451 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.264536 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.264756 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.264855 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.265061 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.265155 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.265361 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.265447 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.265678 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.265780 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.265988 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.266074 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.266298 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.266384 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.266629 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.266723 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.266951 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.267044 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.267251 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.267335 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.267598 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.267714 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.267914 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.268000 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.268224 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.268309 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.268528 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.268617 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.268832 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.268918 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.269133 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.269218 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.269436 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.269523 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.269737 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.269822 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.270040 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.270125 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.270341 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.270434 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.270641 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.270733 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.270940 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.271033 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.271266 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.271353 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.271590 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.271729 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.271907 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.271992 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.272209 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.272295 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.272511 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.272608 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.272810 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.272905 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.273109 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.273203 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.273446 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.273540 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.273756 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.273852 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.274066 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.274159 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.274380 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.274522 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.274691 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.274793 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.275003 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.275091 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.275314 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.275418 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.275644 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.275811 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.275951 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.276036 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.276258 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.276343 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.276562 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.276655 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.276870 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.276956 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.277184 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.277301 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.277488 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.277615 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.277800 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.277932 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.278131 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.278228 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.278459 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.278548 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.278766 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.278861 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.279076 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.279162 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.279394 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.279513 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.279729 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.279818 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.280038 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.280126 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.280364 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.280504 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.280661 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.280757 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.280966 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.281067 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.281270 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.281357 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.281585 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.281690 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.281890 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.282038 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.282184 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.282339 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.282494 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.282591 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.282778 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.282877 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.283085 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.283171 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.283389 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.283533 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.283725 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.283824 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.284032 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.284118 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.284348 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.284441 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.284655 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.284742 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.284967 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.285053 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.285268 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.285353 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.285576 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.285663 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.285881 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.285974 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.286204 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.286290 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.286508 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.286601 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.286840 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.286939 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.287146 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.287234 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.287529 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.287620 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.287778 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.287875 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.288085 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.288180 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.288387 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.288484 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.288689 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.288776 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.288993 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.289094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.289300 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.289386 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.289603 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.289695 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.289909 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.290002 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.290206 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.290291 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.290515 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.290600 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.290821 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.290916 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.291121 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.291206 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.291419 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.291823 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.291999 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.292090 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.292308 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.292393 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.292614 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.292698 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.292930 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.293017 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.293238 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.293325 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.293545 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.293629 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.293848 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.293935 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.294148 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.294233 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.294457 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.294542 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.294755 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.294841 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.295057 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.295332 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.295484 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.295693 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.295782 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.295999 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.296083 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.296301 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.296388 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.296614 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.296701 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.296928 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.297013 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.297231 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.297323 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.297540 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.297640 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.297845 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.297932 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.298149 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.298246 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.298466 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.298561 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.298769 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.298854 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.299070 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.299156 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.299378 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.299549 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.299708 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.299793 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.300011 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.300105 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.300313 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.300408 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.300618 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.300710 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.300921 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.301008 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.301223 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.301311 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.301525 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.301620 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.301822 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.301957 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.302169 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.302256 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.302944 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.303042 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.303257 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.303532 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.303641 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.303868 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.303962 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.304190 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.304276 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.304494 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.304641 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.304797 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.304886 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.305101 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.305188 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.305424 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.305546 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.305752 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.305848 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.306064 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.306152 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.306364 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.306463 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.306670 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.306770 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.306972 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.307058 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.307272 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.307368 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.307601 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.307689 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.307901 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.307987 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.308203 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.308302 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.308504 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.308597 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.308803 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.308890 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.309100 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.309195 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.309397 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.309482 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.309692 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.309776 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.309990 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.310084 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.310295 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.310380 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.310590 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.310688 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.310892 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.310979 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.311186 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.311271 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.311515 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.311616 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.311820 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.311907 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.312119 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.312209 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.312417 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.312513 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.312711 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.312798 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.313015 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.313153 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.313323 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.313419 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.313624 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.313755 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.313931 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.314018 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.314238 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.314333 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.314557 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.314702 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.314863 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.314966 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.315160 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.315259 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.315478 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.315584 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.315795 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.315897 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.316094 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.316196 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.316392 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.316502 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.316694 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.316794 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.316990 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.317079 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.317295 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.317383 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.317595 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.317682 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.317896 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.317983 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.318738 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.318830 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.319038 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.319124 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.319344 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.319453 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.319668 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.319758 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.319979 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.320066 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.320280 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.320368 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.320577 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.320663 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.320875 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.320972 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.321175 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.321261 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.321476 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.321574 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.321773 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.321870 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.322098 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.322212 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.322367 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.322476 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.322662 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.322759 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.322963 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.323058 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.323263 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.323400 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.323586 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.323684 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.323895 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.323983 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.324204 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.324289 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.324499 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.324586 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.324796 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.324886 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.325108 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.325194 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.325406 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.325495 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.325709 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.325845 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.326012 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.326112 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.326311 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.326400 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.326609 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.326741 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.326913 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.327003 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.327230 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.327319 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.327569 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.327659 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.327868 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.327966 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.328175 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.328264 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.328473 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.328559 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.328774 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.328938 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.329074 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.329159 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.329372 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.329456 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.329669 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.329764 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.329965 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.330051 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.330261 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.330348 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.330558 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.330663 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.330855 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.330941 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.331168 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.331262 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.331491 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.331583 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.331792 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.331890 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.332091 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.332178 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.332388 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.332550 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.332689 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.332775 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.332996 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.333083 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.333308 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.333404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.333619 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.333759 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.333954 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.334050 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.334266 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.334382 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.334613 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.334701 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.334916 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.335012 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.335221 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.335308 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.335544 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.335635 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.335846 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.335945 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.336554 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.336658 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.336740 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.336819 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.336895 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.337038 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.337124 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.337210 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.337333 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.337419 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.337634 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.337729 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.337933 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.338018 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.338247 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.338363 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.338565 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.338661 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.338886 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.338973 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.339187 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.339272 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.339513 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.339604 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.339822 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.339910 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.340126 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.340212 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.340432 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.340527 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.340737 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.340825 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.341043 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.341142 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.341349 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.341438 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.341655 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.341750 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.341962 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.342049 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.342269 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.342357 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.342573 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.342662 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.342881 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.342991 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.343184 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.343272 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.343506 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.343609 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.343816 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.343954 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.344124 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.344225 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.344423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.344539 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.344729 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.344826 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.345027 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.345115 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.345333 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.345440 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.345632 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.345753 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.346055 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.346167 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.346363 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.346460 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.346670 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.346768 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.346971 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.347073 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.347278 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.347374 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.347609 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.347700 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.347920 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.348016 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.348230 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.348317 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.348531 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.348620 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.348860 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.348946 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.349183 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.349271 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.349532 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.349620 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.349842 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.349930 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.350141 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.350237 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.350441 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.350528 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.350745 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.350831 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.351060 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.351162 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.351357 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.351475 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.351681 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.351769 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.351980 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.352085 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.352297 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.352405 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.352596 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.352700 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.352911 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.353008 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.353314 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.353415 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.353618 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.353707 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.353916 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.354003 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.354228 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.354324 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.354534 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.354621 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.354838 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.354925 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.355159 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.355254 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.355478 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.355583 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.355792 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.355880 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.356101 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.356197 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.356410 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.356507 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.356712 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.356808 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.357012 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.357108 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.357332 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.357434 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.357628 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.357722 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.357936 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.358022 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.358237 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.358323 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.358553 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.358648 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.358867 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.358953 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.359167 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.359255 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.359502 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.359606 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.359819 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.359905 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.360125 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.360219 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.360430 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.360526 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.360733 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.360820 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.361074 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.361161 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.361380 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.361475 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.361694 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.361781 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.362001 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.362095 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.362302 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.362403 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.362602 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.362688 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.362921 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.363020 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.363222 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.363311 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.363549 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.363642 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.363859 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.363959 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.364171 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.364260 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.364472 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.364571 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.364771 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.364859 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.365615 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.365703 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.365916 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.366009 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.366219 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.366313 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.366523 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.366614 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.366833 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.366920 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.367135 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.367231 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.367458 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.367549 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.367767 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.367853 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.368071 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.368206 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.368373 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.368470 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.368674 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.368761 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.368975 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.369071 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.369275 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.369362 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.369580 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.369667 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.369885 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.369973 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.370211 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.370305 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.370515 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.370601 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.370831 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.370918 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.371140 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.371234 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.371482 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.371574 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.371801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.371899 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.372113 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.372207 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.372427 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.372522 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.372727 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.372813 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.373028 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.373132 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.373333 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.373430 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.373633 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.373728 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.373933 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.374020 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.374231 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.374329 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.374541 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.374629 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.374838 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.374925 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.375137 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.375371 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.375476 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.375727 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.375817 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.376043 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.376130 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.376357 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.376448 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.376673 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.376763 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.376961 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.377071 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.377262 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.377350 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.377562 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.377659 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.377869 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.377965 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.378186 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.378312 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.378497 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.378607 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.378826 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.378932 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.379149 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.379236 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.379494 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.379587 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.379831 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.379927 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.380143 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.380237 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.380453 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.380583 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.381325 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.381423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.381643 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.381733 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.381965 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.382059 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.382340 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.382443 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.382585 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.382673 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.382895 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.383083 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.383256 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.383357 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.383540 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.383776 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.383866 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.384103 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.384192 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.384414 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.384502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.384731 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.384820 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.385043 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.385132 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.385349 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.385435 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.385657 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.385758 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.385968 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.386080 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.386271 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.386359 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.386576 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.386681 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.386884 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.386992 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.387203 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.387303 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.387546 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.387735 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.387884 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.388026 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.388165 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.388387 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.388542 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.388705 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.388839 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.389040 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.389196 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.389364 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.389512 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.389689 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.389844 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.389992 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.390139 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.390283 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.390424 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.390593 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.390727 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.390904 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.391049 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.391194 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.391338 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.391531 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.391666 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.391842 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.391976 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.392148 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.392287 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.392452 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.392599 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.392760 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.392906 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.393053 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.393186 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.393362 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.393496 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.393665 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.393812 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.393983 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.394203 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.394342 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.394564 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.394702 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.394885 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.395032 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.395212 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.395349 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.395559 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.395694 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.395870 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.396058 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.396210 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.396400 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.396537 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.396730 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.396850 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.397057 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.397160 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.397379 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.397467 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.397697 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.397841 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.398017 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.398118 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.398339 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.398430 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.398643 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.398742 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.398948 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.399060 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.399250 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.399337 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.399579 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.399671 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.399905 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.400005 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.400204 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.400318 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.400508 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.400604 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.400803 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.400889 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.401109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.401216 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.401410 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.401505 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.401714 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.401972 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.402073 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.402293 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.402384 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.402606 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.402836 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.402926 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.403019 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.403209 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.403311 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.403537 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.403629 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.403845 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.403996 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.404144 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.404233 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.404443 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.404580 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.404754 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.404894 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.405055 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.405209 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.405345 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.405490 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.405653 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.405804 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.405989 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.406129 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.406276 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.406421 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.406558 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.406702 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.406840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.407029 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.407234 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.407328 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.407490 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.407583 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.407762 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.407851 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.408065 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.408155 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.408370 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.408672 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.408759 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.408980 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.409068 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.409283 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.409384 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.409584 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.409671 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.409886 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.409973 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.410188 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.410284 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.410495 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.410582 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.410796 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.410890 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.411101 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.411221 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.411402 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.411552 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.411737 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.411827 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.412065 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.412156 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.412372 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.412467 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.412669 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.412762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.412976 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.413063 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.413275 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.413361 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.413579 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.413715 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.413891 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.413981 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.414198 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.414285 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.414512 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.414609 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.414820 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.414907 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.415124 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.415212 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.415428 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.415548 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.415801 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.415902 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.416164 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.416353 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.416746 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.416951 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.417136 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.417258 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.417389 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.417589 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.417719 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.417911 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.418012 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.418214 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.418302 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.418522 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.418637 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.418821 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.418909 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.419142 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.419230 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.419502 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.419724 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.419822 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.419904 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.420069 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.420159 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.420376 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.420520 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.420681 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.420835 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.420986 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.421156 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.421294 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.421479 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.421637 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.421792 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.421905 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.422123 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.422247 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.422434 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.422530 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.422746 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.422843 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.423066 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.423164 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.423372 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.423481 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.423708 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.423799 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.424044 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.424133 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.424359 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.424446 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.424679 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.424766 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.424990 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.425086 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.425292 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.425393 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.425596 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.425683 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.425907 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.426068 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.426213 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.426354 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.426492 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.426639 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.426800 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.426947 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.427093 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.427247 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.428061 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.428184 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.428368 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.428516 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.428654 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.428798 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.428938 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.429038 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.429121 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.429285 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.429401 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.429603 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.429700 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.429913 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.430001 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.430231 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.430329 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.430548 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.430645 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.430855 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.430943 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.431154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.431242 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.431486 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.431604 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.431796 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.431886 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.432099 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.432198 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.432403 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.432501 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.432707 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.432803 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.433010 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.433107 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.433328 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.433416 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.433632 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.433720 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.433939 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.434027 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.434255 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.434351 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.434562 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.434649 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.434864 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.434951 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.435170 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.435259 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.435497 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.435588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.435801 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.435888 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.436105 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.436198 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.436407 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.436494 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.436709 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.436804 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.437015 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.437103 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.437375 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.437575 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.437722 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.437871 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.438009 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.438286 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.438376 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.438457 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.438537 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.438627 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.438771 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.438886 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.439118 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.439213 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.439417 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.439547 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.439739 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.439826 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.440037 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.440127 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.440338 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.440428 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.440637 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.440724 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.440965 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.441052 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.441293 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.441384 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.441601 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.441687 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.441909 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.441994 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.442216 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.442310 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.442526 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.442619 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.442830 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.442933 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.443735 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.443835 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.444053 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.444141 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.444368 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.444475 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.444685 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.444781 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.445007 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.445151 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.445335 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.445468 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.445662 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.445778 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.445973 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.446123 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.446300 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.446390 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.446624 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.446712 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.446975 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.447062 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.447290 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.447378 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.447675 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.447790 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.447984 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.448077 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.448303 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.448434 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.448613 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.448702 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.448920 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.449060 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.449217 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 16:56:50.449362 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.449524 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.449853 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.450163 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.450514 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.450825 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.451136 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.451461 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.451784 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.452094 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.452407 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.452725 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.453037 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.453367 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.453691 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.454000 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.454327 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.454651 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.455002 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.455319 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.455686 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.456014 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.456328 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.456642 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.456945 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 16:56:50.457190 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106135) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 16:56:50.602280 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO dbcounter [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Registered counter for database nova_api Aug 18 16:56:50.610308 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO dbcounter [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Registered counter for database nova_api Aug 18 16:56:50.622978 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_db.sqlalchemy.engines [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:56:50.629617 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writer thread running {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:56:50.631205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_db.sqlalchemy.engines [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:56:50.637683 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writer thread running {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:56:50.685701 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.context [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d85d2796-38a5-4d76-99fb-481c052ce6b5(cell1) {{(pid=106134) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 16:56:50.689627 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 16:56:50.690051 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 16:56:50.691658 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 16:56:50.692392 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 16:56:50.692843 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 16:56:50.692939 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.context [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d85d2796-38a5-4d76-99fb-481c052ce6b5(cell1) {{(pid=106135) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 16:56:50.695339 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 16:56:50.697304 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_concurrency.lockutils [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 16:56:50.697412 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO dbcounter [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Registered counter for database nova_cell0 Aug 18 16:56:50.697775 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_concurrency.lockutils [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 16:56:50.699327 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_concurrency.lockutils [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 16:56:50.700082 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_concurrency.lockutils [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 16:56:50.700524 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_concurrency.lockutils [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 16:56:50.702494 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_concurrency.lockutils [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106135) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 16:56:50.702733 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO dbcounter [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Registered counter for database nova_cell1 Aug 18 16:56:50.704469 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO dbcounter [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Registered counter for database nova_cell0 Aug 18 16:56:50.710474 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_db.sqlalchemy.engines [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:56:50.710717 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO dbcounter [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Registered counter for database nova_cell1 Aug 18 16:56:50.713255 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_db.sqlalchemy.engines [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:56:50.717489 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writer thread running {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:56:50.717800 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_db.sqlalchemy.engines [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:56:50.719464 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_db.sqlalchemy.engines [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:56:50.725544 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writer thread running {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:56:50.727415 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writer thread running {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:56:50.853762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writer thread running {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:56:50.863644 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO dbcounter [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Registered counter for database nova_cell0 Aug 18 16:56:50.869598 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO dbcounter [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Registered counter for database nova_cell0 Aug 18 16:56:50.871153 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_db.sqlalchemy.engines [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:56:50.875566 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writer thread running {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:56:50.876524 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG oslo_db.sqlalchemy.engines [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106135) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 16:56:50.881486 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writer thread running {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 16:56:51.297544 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: WARNING keystonemiddleware.auth_token [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 16:56:51.305319 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: WARNING keystonemiddleware.auth_token [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 16:56:51.500399 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: WARNING keystonemiddleware.auth_token [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 16:56:51.508152 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: WARNING keystonemiddleware.auth_token [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 16:56:51.643429 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: WARNING keystonemiddleware.auth_token [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 16:56:51.649922 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: WARNING keystonemiddleware.auth_token [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 16:56:51.655183 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7cb0a49c0 pid: 106134 (default app) Aug 18 16:56:51.657276 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:56:51.658463 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001730 Aug 18 16:56:51.658886 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Thu Aug 18 16:56:51 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:56:51.847713 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: WARNING keystonemiddleware.auth_token [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 16:56:51.854269 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: WARNING keystonemiddleware.auth_token [None req-ebbe107d-062c-42a3-a840-81bef59d06ba None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 16:56:51.859574 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a7cb0a49c0 pid: 106135 (default app) Aug 18 16:58:14.024083 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:14.025218 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Aug 18 16:58:14.025687 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:14 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:58:14.038240 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writing DB stats nova_api:SELECT=3 {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:14.040031 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writing DB stats nova_cell0:SELECT=3 {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:14.041203 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writing DB stats nova_cell1:SELECT=3 {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:14.042243 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:14.935673 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-a9108faf-e546-46fc-90ac-a954d39a05d8 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:14.969284 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-a9108faf-e546-46fc-90ac-a954d39a05d8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.936244 Aug 18 16:58:14.970090 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Aug 18 16:58:14 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:17.350309 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:17.351304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-d30887e8-0539-4667-9989-1d851ebd7b8a None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Aug 18 16:58:17.351920 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 16:58:17.825198 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-382eaf82-3304-412b-bcf0-4f03c44111bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:17.845861 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:58:17.845861 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: warnings.warn(msg) Aug 18 16:58:17.955524 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-382eaf82-3304-412b-bcf0-4f03c44111bc admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.597382 Aug 18 16:58:17.956325 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:17 2022] POST /compute/v2.1/flavors => generated 407 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 16:58:18.214708 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-488d40c4-935a-4b89-a4a3-f430a341f39f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:18.219202 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:58:18.219202 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: warnings.warn(msg) Aug 18 16:58:18.222058 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_api:SELECT=3 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:18.222863 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_cell0:SELECT=3 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:18.223841 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_cell1:SELECT=3 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:18.224549 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:18.350687 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-488d40c4-935a-4b89-a4a3-f430a341f39f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.379511 Aug 18 16:58:18.351555 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Aug 18 16:58:17 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:20.876337 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-382eaf82-3304-412b-bcf0-4f03c44111bc admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:20.877481 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-382eaf82-3304-412b-bcf0-4f03c44111bc admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001515 Aug 18 16:58:20.877942 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 16:58:21.634787 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-e158858c-2b1a-4fe7-b1db-54caecf79ce3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:21.662640 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:58:21.662640 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: warnings.warn(msg) Aug 18 16:58:21.798025 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-e158858c-2b1a-4fe7-b1db-54caecf79ce3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.913562 Aug 18 16:58:21.805947 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:58:21.811343 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-44e49c35-5a27-4fc8-a6d8-87ec61c2fc5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:21.814424 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 16:58:21.814424 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: warnings.warn(msg) Aug 18 16:58:21.909132 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-44e49c35-5a27-4fc8-a6d8-87ec61c2fc5c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101668 Aug 18 16:58:21.910411 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Aug 18 16:58:21 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:24.308334 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-e158858c-2b1a-4fe7-b1db-54caecf79ce3 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:24.309273 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-e158858c-2b1a-4fe7-b1db-54caecf79ce3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Aug 18 16:58:24.309690 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:58:24.704610 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-d6466817-3089-4811-8e75-60b2ff2c51bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d2", "swap": 0, "disk": 10, "rxtx_factor": 1.0, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "vcpus": 1}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:24.793095 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-d6466817-3089-4811-8e75-60b2ff2c51bd admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.477254 Aug 18 16:58:24.793670 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:58:24.806701 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-daf16099-3aad-4699-9a13-50c439680f84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:24.879451 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-daf16099-3aad-4699-9a13-50c439680f84 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076387 Aug 18 16:58:24.880110 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Aug 18 16:58:24 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:27.258135 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-d6466817-3089-4811-8e75-60b2ff2c51bd admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:27.259233 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-d6466817-3089-4811-8e75-60b2ff2c51bd admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Aug 18 16:58:27.259777 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:58:27.692583 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-8b423e05-c8bb-4358-b5e9-1751ff639662 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "disk": 10, "id": "d3", "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:27.807634 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-8b423e05-c8bb-4358-b5e9-1751ff639662 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.541503 Aug 18 16:58:27.808232 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:58:27.820695 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-e6f0ca9e-9078-42e7-a52b-43bd3313215b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:27.913123 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-e6f0ca9e-9078-42e7-a52b-43bd3313215b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096479 Aug 18 16:58:27.914776 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Aug 18 16:58:27 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:30.343641 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-8b423e05-c8bb-4358-b5e9-1751ff639662 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:30.344550 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-8b423e05-c8bb-4358-b5e9-1751ff639662 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Aug 18 16:58:30.345111 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:58:30.809824 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-a0a0918d-8300-4245-8be9-d9953ec8f1bd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "id": "d4", "ram": 4096, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G"}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:30.921118 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-a0a0918d-8300-4245-8be9-d9953ec8f1bd admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.569580 Aug 18 16:58:30.921754 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:58:30.934658 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-ef046ded-79f0-4bd1-ba61-887d77f0bdc6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:31.008772 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-ef046ded-79f0-4bd1-ba61-887d77f0bdc6 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.077806 Aug 18 16:58:31.009395 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1336 bytes} [Thu Aug 18 16:58:30 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:33.405254 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-a0a0918d-8300-4245-8be9-d9953ec8f1bd admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:33.406199 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-a0a0918d-8300-4245-8be9-d9953ec8f1bd admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Aug 18 16:58:33.406601 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:58:33.851741 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-5e591003-2034-45e9-ad77-c35961faae4f admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:33.877022 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-5e591003-2034-45e9-ad77-c35961faae4f admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.463538 Aug 18 16:58:33.877811 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Aug 18 16:58:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 16:58:36.741810 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-a0a0918d-8300-4245-8be9-d9953ec8f1bd admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:36.743078 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-a0a0918d-8300-4245-8be9-d9953ec8f1bd admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001929 Aug 18 16:58:36.743842 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:58:37.226341 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-c0072fc4-f13f-46ef-8679-20d3bdc7503d admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "name": "m1.tiny", "disk": 1, "rxtx_factor": 1.0, "id": "1", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:37.320576 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-c0072fc4-f13f-46ef-8679-20d3bdc7503d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.570011 Aug 18 16:58:37.321054 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:36 2022] POST /compute/v2.1/flavors => generated 402 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 16:58:37.333620 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-8a5fa76b-ceb1-489e-8518-e68bba1778d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:37.457965 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-8a5fa76b-ceb1-489e-8518-e68bba1778d3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.127938 Aug 18 16:58:37.458722 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Aug 18 16:58:37 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:39.786735 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-c0072fc4-f13f-46ef-8679-20d3bdc7503d admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:39.787852 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-c0072fc4-f13f-46ef-8679-20d3bdc7503d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001557 Aug 18 16:58:39.788401 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:58:40.190356 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-0780162c-49de-49a7-8ece-0427261bcccf admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 20, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "swap": 0}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:40.304618 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-0780162c-49de-49a7-8ece-0427261bcccf admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.509582 Aug 18 16:58:40.305083 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:39 2022] POST /compute/v2.1/flavors => generated 405 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:58:40.318561 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-c29b26c0-efe4-4e7a-a2f5-2574c1dae269 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:40.433696 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-c29b26c0-efe4-4e7a-a2f5-2574c1dae269 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119509 Aug 18 16:58:40.434264 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Aug 18 16:58:40 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:42.802551 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-0780162c-49de-49a7-8ece-0427261bcccf admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:42.804320 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-0780162c-49de-49a7-8ece-0427261bcccf admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002205 Aug 18 16:58:42.804800 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 16:58:43.256710 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-104635df-fe71-4d49-94fe-8402a244dea3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "disk": 40, "id": "3", "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:43.334009 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-104635df-fe71-4d49-94fe-8402a244dea3 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.523089 Aug 18 16:58:43.335031 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:42 2022] POST /compute/v2.1/flavors => generated 406 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:58:43.347393 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-a1b13b46-6c10-4ead-9f4c-3fc0979d1a11 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:43.461045 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-a1b13b46-6c10-4ead-9f4c-3fc0979d1a11 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117209 Aug 18 16:58:43.462044 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Aug 18 16:58:43 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:45.864484 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-104635df-fe71-4d49-94fe-8402a244dea3 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:45.865492 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-104635df-fe71-4d49-94fe-8402a244dea3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Aug 18 16:58:45.865890 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:58:46.312046 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-378e1497-1626-448e-945d-700080f6124d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "disk": 80, "ram": 8192, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "os-flavor-access:is_public": true}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:46.319712 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:46.388965 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-378e1497-1626-448e-945d-700080f6124d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.516605 Aug 18 16:58:46.395478 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:58:46.402037 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-96f2d29f-28ce-4895-961a-fc6d3bbfc0b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:46.475184 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-96f2d29f-28ce-4895-961a-fc6d3bbfc0b2 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076540 Aug 18 16:58:46.476010 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Aug 18 16:58:46 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 16:58:48.849128 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-378e1497-1626-448e-945d-700080f6124d admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:58:48.850708 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-378e1497-1626-448e-945d-700080f6124d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Aug 18 16:58:48.851114 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:58:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:58:49.307936 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-59bec049-5041-4f05-bbf5-b68d7b6eeb0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 160, "rxtx_factor": 1.0, "vcpus": 8, "swap": 0, "id": "5", "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge"}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:49.313554 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 16:58:49.404302 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-59bec049-5041-4f05-bbf5-b68d7b6eeb0d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.546965 Aug 18 16:58:49.405223 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1283 bytes} [Thu Aug 18 16:58:48 2022] POST /compute/v2.1/flavors => generated 408 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 16:58:49.417728 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-9947e884-e967-4878-8e5e-6290654f8dc0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:58:49.531738 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-9947e884-e967-4878-8e5e-6290654f8dc0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117698 Aug 18 16:58:49.532540 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1333 bytes} [Thu Aug 18 16:58:49 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 16:59:09.320385 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-59bec049-5041-4f05-bbf5-b68d7b6eeb0d admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:09.321407 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-59bec049-5041-4f05-bbf5-b68d7b6eeb0d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Aug 18 16:59:09.321813 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 16:59:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:59:09.724038 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-953e89fd-3fc5-44cd-98dd-bad7713849b2 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:09.742525 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-953e89fd-3fc5-44cd-98dd-bad7713849b2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.414152 Aug 18 16:59:09.743070 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Aug 18 16:59:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 16:59:10.807664 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-59bec049-5041-4f05-bbf5-b68d7b6eeb0d admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:10.808821 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-59bec049-5041-4f05-bbf5-b68d7b6eeb0d admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Aug 18 16:59:10.809223 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 16:59:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:59:11.343874 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-6aedccae-56a2-4e88-8b77-3c9e5b28c423 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:11.350300 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.wsgi [None req-6aedccae-56a2-4e88-8b77-3c9e5b28c423 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-6aedccae-56a2-4e88-8b77-3c9e5b28c423 admin admin] Request method failure captured: Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Accept: application/json Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Accept-Encoding: gzip, deflate Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Connection: keep-alive Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Content-Length: 0 Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Host: 10.222.0.78 Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Openstack-Api-Version: compute 2.90 Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Openstack-System-Scope: None Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: User-Agent: python-novaclient Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Auth-Token: gAAAAABi_m_eHCdkbeNVLL13dprrDZFQnwuwG1ctqsNad6-lCXCSSaQeaUiKCDns6HyNsdsOAPw20fCmLHjw8NmDOrWgzi_KlYeUlWoTFhACp4cFBMhGJ4QY809u_VpsPgGVl6Uralr_G6KxwKMBWI3oO0m794FM5wWlztUaVmsuiL6hn84e2og Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Domain-Id: None Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Domain-Name: None Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Identity-Status: Confirmed Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Is-Admin-Project: True Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Domain-Id: default Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Domain-Name: Default Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Name: admin Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Role: admin,reader,member Aug 18 16:59:11.354351 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Roles: admin,reader,member Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa954a12b5b948a3954e351b825a86fb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Tenant: admin Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Tenant-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Tenant-Name: admin Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User: admin Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Domain-Id: default Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Domain-Name: Default Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Id: 73657d15e677425f832c000faf7a58ea Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Name: admin Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: method: > Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: exception: Flavor 42 could not be found. Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: action_args: {'id': '42'} Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 16:59:11.356140 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:11.358205 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.359423 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-6aedccae-56a2-4e88-8b77-3c9e5b28c423 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 16:59:11.360603 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-6aedccae-56a2-4e88-8b77-3c9e5b28c423 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.405417 Aug 18 16:59:11.360603 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Aug 18 16:59:10 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 406 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:11.366245 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-16932c0e-16b3-4818-baee-4bb8e95cc4bd admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:11.388958 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-16932c0e-16b3-4818-baee-4bb8e95cc4bd admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026853 Aug 18 16:59:11.389578 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Aug 18 16:59:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 16:59:11.399403 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-a02946e7-ab2b-4f53-bca3-92a193a554ad admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:11.423790 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-a02946e7-ab2b-4f53-bca3-92a193a554ad admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027861 Aug 18 16:59:11.424354 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Aug 18 16:59:11 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 16:59:11.434826 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-a8c43507-f8bf-429a-ac8d-6d3ab94cc0f8 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:11.440626 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.wsgi [None req-a8c43507-f8bf-429a-ac8d-6d3ab94cc0f8 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-a8c43507-f8bf-429a-ac8d-6d3ab94cc0f8 admin admin] Request method failure captured: Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Accept: application/json Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Accept-Encoding: gzip, deflate Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Connection: keep-alive Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Content-Length: 0 Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Host: 10.222.0.78 Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Openstack-Api-Version: compute 2.90 Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Openstack-System-Scope: None Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: User-Agent: python-novaclient Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Auth-Token: gAAAAABi_m_eHCdkbeNVLL13dprrDZFQnwuwG1ctqsNad6-lCXCSSaQeaUiKCDns6HyNsdsOAPw20fCmLHjw8NmDOrWgzi_KlYeUlWoTFhACp4cFBMhGJ4QY809u_VpsPgGVl6Uralr_G6KxwKMBWI3oO0m794FM5wWlztUaVmsuiL6hn84e2og Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Domain-Id: None Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Domain-Name: None Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Identity-Status: Confirmed Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Is-Admin-Project: True Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Domain-Id: default Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Domain-Name: Default Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Name: admin Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Role: admin,reader,member Aug 18 16:59:11.443856 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Roles: admin,reader,member Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa954a12b5b948a3954e351b825a86fb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Tenant: admin Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Tenant-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Tenant-Name: admin Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User: admin Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Domain-Id: default Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Domain-Name: Default Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Id: 73657d15e677425f832c000faf7a58ea Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Name: admin Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: method: > Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: exception: Flavor 42 could not be found. Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: action_args: {'id': '42'} Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 16:59:11.458762 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:11.459801 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:11.461109 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-a8c43507-f8bf-429a-ac8d-6d3ab94cc0f8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 16:59:11.462485 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-a8c43507-f8bf-429a-ac8d-6d3ab94cc0f8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014457 Aug 18 16:59:11.462485 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Aug 18 16:59:11 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:12.429138 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-a02946e7-ab2b-4f53-bca3-92a193a554ad admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:12.430146 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-a02946e7-ab2b-4f53-bca3-92a193a554ad admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Aug 18 16:59:12.430566 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 16:59:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:59:12.951771 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-4bf01466-9141-45fe-8662-88e0b795bdb8 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:12.957059 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.wsgi [None req-4bf01466-9141-45fe-8662-88e0b795bdb8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-4bf01466-9141-45fe-8662-88e0b795bdb8 admin admin] Request method failure captured: Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Accept: application/json Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Accept-Encoding: gzip, deflate Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Connection: keep-alive Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Content-Length: 0 Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Host: 10.222.0.78 Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Openstack-Api-Version: compute 2.90 Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Openstack-System-Scope: None Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: User-Agent: python-novaclient Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Auth-Token: gAAAAABi_m_gXd6xh7uaWWQGUlBE16ZJEumoU3smVNW0oxwtAqSlDMCK8zys1JcHyCgTZIXXIGppXwRkdeAbTvnhFVLRFgdKObQd-GPEyVHfJULfKBUbwJlhASZ2YuSmxuMXam1kLVb69sW8amHPAS8wwifC73w5k5ZWPG1F5pCwyGbBYTmzNSA Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Domain-Id: None Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Domain-Name: None Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Identity-Status: Confirmed Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Is-Admin-Project: True Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Domain-Id: default Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Domain-Name: Default Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Name: admin Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Role: admin,reader,member Aug 18 16:59:12.958588 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Roles: admin,reader,member Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa954a12b5b948a3954e351b825a86fb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Tenant: admin Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Tenant-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Tenant-Name: admin Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User: admin Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Domain-Id: default Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Domain-Name: Default Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Id: 73657d15e677425f832c000faf7a58ea Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Name: admin Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: method: > Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: exception: Flavor 84 could not be found. Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: action_args: {'id': '84'} Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 16:59:12.960154 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:12.961006 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:12.962094 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-4bf01466-9141-45fe-8662-88e0b795bdb8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 16:59:12.963165 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-4bf01466-9141-45fe-8662-88e0b795bdb8 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.392087 Aug 18 16:59:12.963165 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Aug 18 16:59:12 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:12.969746 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-52ff59ba-1da9-40af-9e1d-ad9082a87382 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:12.985041 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-52ff59ba-1da9-40af-9e1d-ad9082a87382 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018773 Aug 18 16:59:12.985604 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Aug 18 16:59:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 16:59:12.995889 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-d61c075e-16bd-40c3-ba09-d640615c0320 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:13.012987 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-d61c075e-16bd-40c3-ba09-d640615c0320 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020629 Aug 18 16:59:13.013480 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Aug 18 16:59:12 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 16:59:13.023465 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-003d0e59-a93d-41dc-a4c1-7ae87d0fc42a admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:13.028915 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.wsgi [None req-003d0e59-a93d-41dc-a4c1-7ae87d0fc42a admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-003d0e59-a93d-41dc-a4c1-7ae87d0fc42a admin admin] Request method failure captured: Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Accept: application/json Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Accept-Encoding: gzip, deflate Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Connection: keep-alive Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Content-Length: 0 Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Host: 10.222.0.78 Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Openstack-Api-Version: compute 2.90 Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Openstack-System-Scope: None Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: User-Agent: python-novaclient Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Auth-Token: gAAAAABi_m_gXd6xh7uaWWQGUlBE16ZJEumoU3smVNW0oxwtAqSlDMCK8zys1JcHyCgTZIXXIGppXwRkdeAbTvnhFVLRFgdKObQd-GPEyVHfJULfKBUbwJlhASZ2YuSmxuMXam1kLVb69sW8amHPAS8wwifC73w5k5ZWPG1F5pCwyGbBYTmzNSA Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Domain-Id: None Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Domain-Name: None Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Identity-Status: Confirmed Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Is-Admin-Project: True Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Domain-Id: default Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Domain-Name: Default Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Name: admin Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Role: admin,reader,member Aug 18 16:59:13.030404 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Roles: admin,reader,member Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa954a12b5b948a3954e351b825a86fb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Tenant: admin Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Tenant-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Tenant-Name: admin Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User: admin Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Domain-Id: default Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Domain-Name: Default Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Id: 73657d15e677425f832c000faf7a58ea Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Name: admin Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: method: > Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: exception: Flavor 84 could not be found. Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: action_args: {'id': '84'} Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 16:59:13.031891 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:13.032840 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:13.034025 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-003d0e59-a93d-41dc-a4c1-7ae87d0fc42a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 16:59:13.035075 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-003d0e59-a93d-41dc-a4c1-7ae87d0fc42a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012330 Aug 18 16:59:13.035075 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Thu Aug 18 16:59:13 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:14.010009 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-d61c075e-16bd-40c3-ba09-d640615c0320 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:14.011017 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-d61c075e-16bd-40c3-ba09-d640615c0320 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Aug 18 16:59:14.011406 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 16:59:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:59:14.541982 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-97de1778-d2aa-4314-b099-c9b0340e598a admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:14.547881 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.wsgi [None req-97de1778-d2aa-4314-b099-c9b0340e598a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-97de1778-d2aa-4314-b099-c9b0340e598a admin admin] Request method failure captured: Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Accept: application/json Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Accept-Encoding: gzip, deflate Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Connection: keep-alive Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Content-Length: 0 Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Host: 10.222.0.78 Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Openstack-Api-Version: compute 2.90 Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Openstack-System-Scope: None Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: User-Agent: python-novaclient Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Auth-Token: gAAAAABi_m_h_RgEuy2R3gjVqWGpZ_GZ-m_DizinkJDhJIbiRDPyLEJjSAFlFTQH0-W1GUgG5RV2QPv-lLa7dWYHpIPG4WIT70ihOIzbi9ke83kqjOVDowVr9AjarTndS0wMZInHKwg9Z2bEGQHqQMyYFYNioRoLRRpeN2TljOxoX_Hm2nMOJjo Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Domain-Id: None Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Domain-Name: None Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Identity-Status: Confirmed Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Is-Admin-Project: True Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Domain-Id: default Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Domain-Name: Default Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Project-Name: admin Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Role: admin,reader,member Aug 18 16:59:14.549391 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Roles: admin,reader,member Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa954a12b5b948a3954e351b825a86fb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Tenant: admin Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Tenant-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-Tenant-Name: admin Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User: admin Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Domain-Id: default Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Domain-Name: Default Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Id: 73657d15e677425f832c000faf7a58ea Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: X-User-Name: admin Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: method: > Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: exception: Flavor 451 could not be found. Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: action_args: {'id': '451'} Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 16:59:14.551449 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:14.552535 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.553869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-97de1778-d2aa-4314-b099-c9b0340e598a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106135) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 16:59:14.555248 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-97de1778-d2aa-4314-b099-c9b0340e598a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.400287 Aug 18 16:59:14.555248 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Aug 18 16:59:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 402 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:14.561305 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-6026608a-0f94-4a55-b946-44c6d00deec6 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:14.576626 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-6026608a-0f94-4a55-b946-44c6d00deec6 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018992 Aug 18 16:59:14.577151 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Aug 18 16:59:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 16:59:14.586656 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:14.601486 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018422 Aug 18 16:59:14.602020 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Thu Aug 18 16:59:14 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 16:59:14.611469 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-64f0f163-0864-40a9-871b-6ad1e338c5ff admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:14.617359 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.wsgi [None req-64f0f163-0864-40a9-871b-6ad1e338c5ff admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-64f0f163-0864-40a9-871b-6ad1e338c5ff admin admin] Request method failure captured: Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Accept: application/json Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Accept-Encoding: gzip, deflate Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Connection: keep-alive Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Content-Length: 0 Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Host: 10.222.0.78 Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Openstack-Api-Version: compute 2.90 Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Openstack-System-Scope: None Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: User-Agent: python-novaclient Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Auth-Token: gAAAAABi_m_h_RgEuy2R3gjVqWGpZ_GZ-m_DizinkJDhJIbiRDPyLEJjSAFlFTQH0-W1GUgG5RV2QPv-lLa7dWYHpIPG4WIT70ihOIzbi9ke83kqjOVDowVr9AjarTndS0wMZInHKwg9Z2bEGQHqQMyYFYNioRoLRRpeN2TljOxoX_Hm2nMOJjo Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Domain-Id: None Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Domain-Name: None Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Identity-Status: Confirmed Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Is-Admin-Project: True Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Openstack-Nova-Api-Version: 2.90 Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Domain-Id: default Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Domain-Name: Default Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Project-Name: admin Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Role: admin,reader,member Aug 18 16:59:14.619019 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Roles: admin,reader,member Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aa954a12b5b948a3954e351b825a86fb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aa954a12b5b948a3954e351b825a86fb", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Tenant: admin Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Tenant-Id: aa954a12b5b948a3954e351b825a86fb Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-Tenant-Name: admin Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User: admin Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Domain-Id: default Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Domain-Name: Default Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Id: 73657d15e677425f832c000faf7a58ea Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: X-User-Name: admin Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: method: > Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: exception: Flavor 451 could not be found. Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: action_args: {'id': '451'} Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 16:59:14.620502 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:14.621304 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: ERROR nova.api.openstack.wsgi Aug 18 16:59:14.622581 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-64f0f163-0864-40a9-871b-6ad1e338c5ff admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 16:59:14.623645 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-64f0f163-0864-40a9-871b-6ad1e338c5ff admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012711 Aug 18 16:59:14.623645 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Aug 18 16:59:14 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 18 16:59:15.578822 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:15.579869 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 18 16:59:15.580266 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 16:59:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:59:16.117402 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-ed1edb48-ebdd-4d4c-948d-3143290e20d9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:59:16.213185 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-ed1edb48-ebdd-4d4c-948d-3143290e20d9 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.488165 Aug 18 16:59:16.213767 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Thu Aug 18 16:59:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:59:17.176790 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:17.177862 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002142 Aug 18 16:59:17.178257 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 16:59:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:59:17.717783 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-c188d38e-8891-4c06-b5f4-0dc6b950c739 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:59:17.798279 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-c188d38e-8891-4c06-b5f4-0dc6b950c739 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.484645 Aug 18 16:59:17.798839 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Thu Aug 18 16:59:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:59:18.770384 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:18.771400 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002047 Aug 18 16:59:18.775497 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 16:59:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:59:19.303988 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-16719598-1190-4824-abdc-fc1ba22b098c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:59:19.395831 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-16719598-1190-4824-abdc-fc1ba22b098c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.485225 Aug 18 16:59:19.396373 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Thu Aug 18 16:59:18 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:59:20.381280 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:20.382284 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 18 16:59:20.382786 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 16:59:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:59:20.904128 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-541826d7-c9fc-43c1-b4c7-cafacf548b97 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 16:59:21.048750 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-541826d7-c9fc-43c1-b4c7-cafacf548b97 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.526987 Aug 18 16:59:21.049208 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Thu Aug 18 16:59:20 2022] POST /compute/v2.1/flavors => generated 409 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 16:59:22.015226 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:22.016286 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Aug 18 16:59:22.016700 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 16:59:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 16:59:22.547747 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-1d097bad-fb9a-44d7-8dba-5a1286ffe95a admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 16:59:22.569017 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-1d097bad-fb9a-44d7-8dba-5a1286ffe95a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.414329 Aug 18 16:59:22.569484 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Thu Aug 18 16:59:22 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:00:16.760880 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:00:16.761900 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-06a65243-0b1b-4d03-8ec1-4d5c3e938071 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 18 17:00:16.762309 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 931 bytes} [Thu Aug 18 17:00:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:00:16.773011 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:17.153232 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-34d93cc3-d37a-47bc-b1a4-76978f2473a5 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:00:17.173571 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-34d93cc3-d37a-47bc-b1a4-76978f2473a5 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404986 Aug 18 17:00:17.174105 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1292 bytes} [Thu Aug 18 17:00:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:00:17.195374 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG dbcounter [-] [106135] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106135) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:00:17.199189 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-53c84c9b-0e1c-4610-bbb2-9a774c60332b admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:00:17.207548 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-53c84c9b-0e1c-4610-bbb2-9a774c60332b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013554 Aug 18 17:00:17.208079 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1283 bytes} [Thu Aug 18 17:00:17 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:00:17.219791 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-47af0742-e362-4e0d-af6d-6360abed006c admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:00:17.227830 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-47af0742-e362-4e0d-af6d-6360abed006c admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011716 Aug 18 17:00:17.228350 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1286 bytes} [Thu Aug 18 17:00:17 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:00:17.240095 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:00:17.248207 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012017 Aug 18 17:00:17.248730 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1286 bytes} [Thu Aug 18 17:00:17 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:00:17.261217 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-58b42bb1-2764-46a8-a7f8-0e41e3b990e3 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:00:17.269180 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-58b42bb1-2764-46a8-a7f8-0e41e3b990e3 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011997 Aug 18 17:00:17.269712 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1283 bytes} [Thu Aug 18 17:00:17 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:03:26.360271 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:03:26.361299 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Aug 18 17:03:26.361692 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 17:03:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:03:26.506768 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_api:SELECT=6 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:03:26.667884 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-f0aa2f19-ddfb-449b-876f-9dddc6e030ff admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:03:26.670195 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:03:26.670195 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: warnings.warn(msg) Aug 18 17:03:26.671329 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f19-ddfb-449b-876f-9dddc6e030ff admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:26.671934 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f19-ddfb-449b-876f-9dddc6e030ff admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:26.672364 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f19-ddfb-449b-876f-9dddc6e030ff admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:26.673076 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f19-ddfb-449b-876f-9dddc6e030ff admin admin] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:26.673520 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f19-ddfb-449b-876f-9dddc6e030ff admin admin] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:26.673939 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-f0aa2f19-ddfb-449b-876f-9dddc6e030ff admin admin] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:26.707649 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-f0aa2f19-ddfb-449b-876f-9dddc6e030ff admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.206681 Aug 18 17:03:26.708217 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Aug 18 17:03:26 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:03:27.545563 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:03:27.546594 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 18 17:03:27.546991 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 17:03:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:03:27.772126 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-1f527ed2-a372-479d-8f67-485aab8c0250 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:03:27.774590 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:03:27.774590 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: warnings.warn(msg) Aug 18 17:03:27.775967 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-1f527ed2-a372-479d-8f67-485aab8c0250 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:27.776453 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-1f527ed2-a372-479d-8f67-485aab8c0250 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:27.776943 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-1f527ed2-a372-479d-8f67-485aab8c0250 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:27.777665 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-1f527ed2-a372-479d-8f67-485aab8c0250 admin admin] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:27.778119 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-1f527ed2-a372-479d-8f67-485aab8c0250 admin admin] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:27.778543 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-1f527ed2-a372-479d-8f67-485aab8c0250 admin admin] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:27.799235 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-1f527ed2-a372-479d-8f67-485aab8c0250 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.082117 Aug 18 17:03:27.800504 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Aug 18 17:03:27 2022] GET /compute/v2.1/os-services => generated 791 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 17:03:39.060353 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:03:39.061353 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 18 17:03:39.061744 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 36/73] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 17:03:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:03:39.205696 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_cell0:SELECT=4 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:03:39.206432 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_cell1:SELECT=4 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:03:39.207051 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG dbcounter [-] [106134] Writing DB stats nova_api:SELECT=8 {{(pid=106134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:03:39.255710 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-79789b36-6340-4704-aefb-1357800dc6d8 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:03:39.258062 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:03:39.258062 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: warnings.warn(msg) Aug 18 17:03:39.259159 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-79789b36-6340-4704-aefb-1357800dc6d8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:39.259667 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-79789b36-6340-4704-aefb-1357800dc6d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:39.260102 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-79789b36-6340-4704-aefb-1357800dc6d8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:39.260850 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-79789b36-6340-4704-aefb-1357800dc6d8 admin admin] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:39.261291 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-79789b36-6340-4704-aefb-1357800dc6d8 admin admin] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:39.261701 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-79789b36-6340-4704-aefb-1357800dc6d8 admin admin] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:39.288632 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-79789b36-6340-4704-aefb-1357800dc6d8 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.086919 Aug 18 17:03:39.288822 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 38/74] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Aug 18 17:03:39 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:03:40.124573 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: DEBUG nova.api.openstack.wsgi [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] Calling method '>' {{(pid=106135) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:03:40.125566 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: INFO nova.api.openstack.requestlog [None req-d1e8cb3b-9544-49a1-b6ae-fbd27a9ed898 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Aug 18 17:03:40.125961 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: [pid: 106135|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1074 bytes} [Thu Aug 18 17:03:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:03:40.316858 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG nova.api.openstack.wsgi [None req-9e2cc938-3556-4f39-a9b0-c6ddb2834445 admin admin] Calling method '>' {{(pid=106134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:03:40.319832 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 17:03:40.319832 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: warnings.warn(msg) Aug 18 17:03:40.320948 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-9e2cc938-3556-4f39-a9b0-c6ddb2834445 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:40.321426 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-9e2cc938-3556-4f39-a9b0-c6ddb2834445 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:40.321887 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-9e2cc938-3556-4f39-a9b0-c6ddb2834445 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:40.322610 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-9e2cc938-3556-4f39-a9b0-c6ddb2834445 admin admin] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:03:40.323061 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-9e2cc938-3556-4f39-a9b0-c6ddb2834445 admin admin] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:03:40.323507 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: DEBUG oslo_concurrency.lockutils [None req-9e2cc938-3556-4f39-a9b0-c6ddb2834445 admin admin] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:03:40.346121 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: INFO nova.api.openstack.requestlog [None req-9e2cc938-3556-4f39-a9b0-c6ddb2834445 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.082336 Aug 18 17:03:40.346607 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: [pid: 106134|app: 0|req: 39/76] 10.222.0.78 () {60 vars in 1193 bytes} [Thu Aug 18 17:03:40 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:04:36.705103 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: Thu Aug 18 17:04:36 2022 - graceful shutdown triggered... Aug 18 17:04:36.706150 dv-cinder-853678-2-iscsi devstack@n-api.service[106134]: Gracefully killing worker 1 (pid: 106134)... Aug 18 17:04:36.706513 dv-cinder-853678-2-iscsi devstack@n-api.service[106135]: Gracefully killing worker 2 (pid: 106135)... Aug 18 17:04:36.708013 dv-cinder-853678-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 18 17:04:37.706784 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: worker 1 buried after 1 seconds Aug 18 17:04:37.707484 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: worker 2 buried after 1 seconds Aug 18 17:04:37.707484 dv-cinder-853678-2-iscsi devstack@n-api.service[106123]: goodbye to uWSGI. Aug 18 17:04:37.708471 dv-cinder-853678-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 18 17:04:37.709033 dv-cinder-853678-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 18 17:04:37.711914 dv-cinder-853678-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 18 17:04:37.723400 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 17:04:37 2022] *** Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: nodename: dv-cinder-853678-2-iscsi Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: machine: x86_64 Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: clock source: unix Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: pcre jit disabled Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: detected number of CPU cores: 4 Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: current working directory: / Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: detected binary path: /usr/bin/uwsgi-core Aug 18 17:04:37.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: your processes number limit is 47680 Aug 18 17:04:37.726886 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: your memory page size is 4096 bytes Aug 18 17:04:37.726886 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: detected max file descriptor number: 2048 Aug 18 17:04:37.726886 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: lock engine: pthread robust mutexes Aug 18 17:04:37.726886 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: thunder lock: enabled Aug 18 17:04:37.726886 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 18 17:04:37.726886 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 17:04:37.766523 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: Python main interpreter initialized at 0x560df940e9c0 Aug 18 17:04:37.766523 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: python threads support enabled Aug 18 17:04:37.766523 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: your server socket listen backlog is limited to 100 connections Aug 18 17:04:37.766523 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: your mercy for graceful operations on workers is 90 seconds Aug 18 17:04:37.766981 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 17:04:37.766981 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: *** Operational MODE: preforking *** Aug 18 17:04:37.767333 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: *** uWSGI is running in multiple interpreter mode *** Aug 18 17:04:37.767333 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: spawned uWSGI master process (pid: 121248) Aug 18 17:04:37.767468 dv-cinder-853678-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 18 17:04:37.769642 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: spawned uWSGI worker 1 (pid: 121267, cores: 1) Aug 18 17:04:37.769642 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: spawned uWSGI worker 2 (pid: 121268, cores: 1) Aug 18 17:04:37.769642 dv-cinder-853678-2-iscsi devstack@n-api.service[121248]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 17:04:38.430572 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 17:04:38.433544 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 18 17:04:39.589857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:04:39.589857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: from cryptography.utils import int_from_bytes Aug 18 17:04:39.590581 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:04:39.590581 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: from cryptography.utils import int_from_bytes Aug 18 17:04:39.591048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:04:39.591048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: from cryptography.utils import int_from_bytes Aug 18 17:04:39.591198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 17:04:39.591198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: from cryptography.utils import int_from_bytes Aug 18 17:04:42.030629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 17:04:42.031203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 17:04:42.031615 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 17:04:42.031718 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 17:04:42.031794 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 17:04:42.031876 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 17:04:42.031956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 17:04:42.032027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 17:04:42.032115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 17:04:42.032186 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 17:04:42.032413 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.032522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.032858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.033096 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.033196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.033419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.033511 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.033753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.033858 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.034076 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.034187 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.034405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.034505 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.034725 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.034827 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.035056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.035169 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.035319 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.035410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.035672 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.035823 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.035999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853678-2-iscsi {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.036100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-853678-2-iscsi {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.036370 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.036480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.036782 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.036881 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.037101 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.037202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.037420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.037541 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.037732 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.037827 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.038056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.038152 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.038366 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.038469 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.038868 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.038988 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.039349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.039479 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.039660 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.039761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.039950 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.040199 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.040303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.040390 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.040597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.040721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.040928 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.041038 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.041249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.041398 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.041568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.041673 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.041867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.042107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.042196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.042283 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.042573 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853678-2-iscsi {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.042729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-853678-2-iscsi {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.042894 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.042996 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.043211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.043309 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.043547 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.043653 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.043966 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.044069 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.044282 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.044383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.044591 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.044689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.044912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.045011 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.045235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.045335 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.045543 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.045646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.045898 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.046044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.046201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.046339 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.046520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.046658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.046841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.046985 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.047144 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.047237 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.047470 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.047573 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.047785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.047885 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.048105 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.048203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.048419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.048560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.049253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.049393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.050943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.051128 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.051280 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.052226 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.052422 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.052585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.052738 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.052903 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.053055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.053219 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.053378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.053530 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.053683 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.053833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.053998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.054142 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.054293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.054459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.054603 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.054752 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.054912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.055063 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.055219 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.055363 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.055540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.055703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.055861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.056012 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.056162 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.056317 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.056466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.056622 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.056828 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.056918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.057001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.057083 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.057172 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.057259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.057400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.057490 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.057674 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.057835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.057937 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058032 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058316 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058316 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058549 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058645 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058819 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058904 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.058986 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.059081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.059165 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.059247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.059328 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.059511 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.059644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.059746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.059832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.059924 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060008 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060171 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060265 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060441 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060848 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.060848 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.061046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.061202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.061354 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.061495 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.061592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.061676 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.061765 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.061870 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.061956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.062083 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.062211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.062378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.062473 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.062694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.062984 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.062984 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.063152 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.063293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.063392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.063628 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.063729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.063936 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.064036 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.064269 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.064869 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.065127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.065225 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.065449 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.065556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.065755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.065879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.066066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.066176 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.066387 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.066533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.066740 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.066872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.067002 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.067131 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.067385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.067537 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.067638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.067720 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.068039 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.068219 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.068314 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.068395 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.068586 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.068703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.068863 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.068973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.069172 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.069283 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.069479 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.069597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.069793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.069975 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.070124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.070290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.070435 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.070573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.070721 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.070874 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.071014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.071152 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.071305 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.071506 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.071660 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.071811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.071960 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.072117 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.072368 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.072509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.072661 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.072801 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.072955 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.073102 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.073248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.073386 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.073641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.073793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.073939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.074088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.074245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.074384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.074539 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.074677 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.074823 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.074968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.075105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.075254 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.075393 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.075560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.075706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.075851 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.075995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.076158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.076306 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.076457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.076606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.076746 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 17:04:42.076884 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.077028 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.077117 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.077208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.077370 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.077473 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.077709 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.077810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.078044 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.078134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.078364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.078456 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.078680 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.078773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.078997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.079087 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.079326 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.079418 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.079667 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.079832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.080010 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.080103 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.080325 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.080416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.080638 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.080737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.080957 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.081099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.081277 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.081418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.081601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.081741 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.081920 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.082011 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.082239 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.082357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.082553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.082667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.082864 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.082964 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.083188 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.083279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.083531 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.083643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.083849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.083965 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.084156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.084256 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.084509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.084611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.084824 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.084922 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.085150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.085269 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.085477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.085577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.085790 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.085891 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.086101 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.086192 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.086414 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.086512 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.086733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.086839 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.087064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.087238 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.087376 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.087544 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.087724 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.087817 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.088042 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.088158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.088355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.088446 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.088667 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.088768 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.088980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.089083 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.089289 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.089388 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.089604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.089716 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.089935 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.090076 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.090250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.090363 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.090567 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.090657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.090884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.090982 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.091200 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.091288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.091540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.091643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.091856 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.091956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.092165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.092267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.092471 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.092561 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.092777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.092869 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.093088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.093188 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.093392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.093495 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.093702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.093792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.094029 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.094127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.094335 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.094424 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.094663 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.094760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.094968 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.095057 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.095280 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.095384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.095639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.095731 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.095954 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.096044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.097311 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.097430 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.097515 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.097597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.097674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.097744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.097820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.097899 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.097969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.098047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.098123 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.098193 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.098267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.098344 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.098413 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.098527 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.098901 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.099065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.099227 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.099381 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.099519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.099680 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.099841 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.100013 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.100324 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.100497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.100793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.100885 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.100969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.101061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.101156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.101306 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.101447 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.101535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.101617 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.101713 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.101797 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.102014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.102106 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.102349 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.102448 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.102660 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.102752 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.102987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.103088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.103315 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.103413 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.103659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.103753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.103967 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.104058 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.104279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.104368 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.104587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.104686 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.104894 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.104986 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.105199 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.105297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.105512 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.105611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.105819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.105917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.106136 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.106280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.106545 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.106644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.106730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.106820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.107022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.107146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.107348 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.107519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.107677 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.107769 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.107985 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.108096 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.108297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.108425 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.108744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.108854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.108944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.109040 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.109234 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.109347 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.109576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.109674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.109917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.110008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.110237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.110322 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.110563 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.110676 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.110885 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.110986 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.111775 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.111892 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.112095 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.112198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.112415 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.112506 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.112730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.112827 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.113047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.113155 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.113373 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.113463 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.113688 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.113799 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.114014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.114115 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.114328 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.114434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.114653 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.114751 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.114968 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.115068 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.115294 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.115383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.115628 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.115717 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.115948 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.116052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.116292 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.116382 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.116633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.116810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.116961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.117133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.117278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.117434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.117598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.117712 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.117884 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.117978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.118198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.118299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.118513 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.118604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.118826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.118919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.119143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.119235 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.119496 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.119596 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.119800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.119901 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.120121 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.120213 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.120435 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.120539 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.120760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.120859 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.121073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.121172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.121394 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.121484 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.121701 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.121801 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.122020 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.122135 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.122352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.122460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.122686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.122777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.122997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.123167 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.123313 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.123420 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.123706 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.123844 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.123987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.124112 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.124301 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.124490 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.124606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.124724 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.124919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.125234 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.125558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.125730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.125876 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.126027 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.126170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.126345 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.126505 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.126670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.127492 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.127667 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.127892 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.128044 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.128218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.128363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.128519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.128671 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.128820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.128970 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.129125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.129342 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.129665 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.129999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.130332 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.130650 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.130963 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.131295 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.131643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.131872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.131991 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.132230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.132359 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.132997 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.133133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.133249 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.133366 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.133492 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.133612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.133731 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.133843 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.133961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.134073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.134193 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.134305 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.134438 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.134556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.134762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.134888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.135080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.135200 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.135396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.135660 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.135832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.136066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.136207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.136382 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.136608 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.136748 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.137008 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.137154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.137327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.137557 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.137689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.137964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.138128 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.138356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.138490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.138619 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.138884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.139023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.139194 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.139534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.139854 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.139990 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.140302 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.140499 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.140781 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.140925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.141107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.141401 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.141542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.141748 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.141890 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.142076 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.142330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.142497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.142792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.142927 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.143154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.143294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.143506 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.143741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.143880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.144134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.144268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.144448 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.144642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.144785 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.145067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.145199 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.145380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.145557 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.145689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.146003 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.146136 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.146305 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.146483 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.146626 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.146909 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.147056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.147204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.147506 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.147666 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.147852 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.148120 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.148272 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.148559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.148780 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.148933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.149096 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.149408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.149697 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.149832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.150015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.150285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.150424 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.150871 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.151018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.151148 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.151315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.151735 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.151969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.152182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.152316 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.152585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.152724 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.152917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.153126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.153260 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.153527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.153667 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.153837 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.154058 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.154209 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.154457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.154590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.154768 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.154956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.155098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.155385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.155560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.155731 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.155877 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.156049 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.156461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.156606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.156737 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.156874 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.157021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.157259 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.157408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.158746 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.158895 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.159030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.159177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.159309 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.159482 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.159715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.159863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.160029 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.160177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.160308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.160308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.160308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.160685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.160843 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.161052 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.161189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.161189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.161447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.161585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.161585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.161849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.161979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.161979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.162232 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.162368 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.162574 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.162712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.162849 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.162985 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.163128 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.163374 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.163689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.163830 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.163968 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.164105 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.164308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.164477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.164636 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.165305 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.165453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.165453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.165715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.165856 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.165987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.166124 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.166124 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.166382 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.166540 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.166761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.166896 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.167026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.167249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.167392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.167671 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.167903 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.168047 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.168187 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.168423 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.168601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.168748 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.168979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.169182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.169314 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.169524 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.169774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.169928 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.170171 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.170312 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.170505 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.170643 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.170851 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.171170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.171319 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.171499 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.171772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.171908 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.172139 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.172284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.172457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.172675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.172820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.173076 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.173218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.173400 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.173581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.174247 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.174534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.174675 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.174871 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.175011 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.175182 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.175449 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.175585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.175862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.176189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.176330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.176500 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.176713 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.176928 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.177141 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.177290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.177450 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.177623 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.177757 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.178051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.178198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.178445 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.178597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.178729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.178959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.179207 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.179351 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.179500 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.179646 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.179944 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.180151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.180294 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.180572 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.180696 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.180886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.181155 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.181373 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.181515 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.181658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.181798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.182129 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.182333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.182490 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.182632 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.182771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.183048 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.183190 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.183360 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.183637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.183789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.184005 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.184146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.184453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.184596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.184774 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.184916 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.185143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.185344 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.185480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.185693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.185822 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.186016 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.186247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.186379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.186644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.186772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.187000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.187144 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.187382 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.187586 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.187729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.188017 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.188160 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.188358 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.188659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.188803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.188970 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.189142 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.189924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.190189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.190347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.190481 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.190764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.190907 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.191080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.191331 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.191628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.191787 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.191929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.192121 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.192358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.192555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.192792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.192934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.193180 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.193322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.193605 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.193747 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.193925 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.194161 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.194294 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.196478 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.196652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.196780 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.196922 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.197071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.197294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.197451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.197590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.197730 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.197861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.197990 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.198129 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.198267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.198397 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.198533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.198533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.198896 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.199045 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.199045 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.199302 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.199455 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.199600 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.199730 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.199730 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.200123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.202945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.203107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.203244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.203244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.203571 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.203707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.203707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.203952 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.204083 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.204230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.204369 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.204506 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.204635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.204772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.204924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.205065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.205208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.205339 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.205476 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.205605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.205741 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.205886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.206023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.206023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.206284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.206415 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.206543 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.206684 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.206684 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.206938 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.207067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.207067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.207339 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.207571 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.207721 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.207853 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.207853 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.208108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.208247 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.208247 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.208501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.208637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.208767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.208913 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.208913 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.209350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.209491 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.209622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.209758 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.209758 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.210011 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.210157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.210157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.210656 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.210801 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.210942 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.211071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.211216 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.211356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.211356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.211356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.211745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.211745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.211997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.212319 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.212724 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.213114 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.213482 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.213867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.214249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.214637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.215019 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.215662 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.216055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.216454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.216832 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.217213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.217636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.217973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.218363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.218738 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.219235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.219646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.220029 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.220278 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.221210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.221366 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.221554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.221745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.221915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.222233 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.222472 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.222615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.222746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.222886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.223194 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.223345 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.223533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.223745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.223879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.224174 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.224307 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.224498 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.224659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.224817 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.225105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.225249 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.225538 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.225673 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.225925 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.226065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.226303 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.226607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.226742 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.226979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.227111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.227318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.227503 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.227755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.228049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.228194 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.228472 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.228612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.228832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.228966 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.229190 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.229434 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.229684 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.229825 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.229971 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.230191 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.230383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.230517 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.230813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.230962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.231379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.231637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.231771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.231917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.232050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.232190 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.232612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.232761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.232900 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.233038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.233350 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.233560 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.233716 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.233846 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.234058 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.234193 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.234456 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.234600 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.234785 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.235002 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.235137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.235464 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.235620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.235824 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.235974 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.236136 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.237005 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.237159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.237333 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.237625 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.237759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.237989 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.238315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.238655 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.238831 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.239007 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.239284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.239600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.239749 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.239901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.240033 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.240277 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.240531 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.240677 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.240816 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.241034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.241289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.241689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.241817 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.241937 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.242241 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.243074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.243074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.243349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.243690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.243951 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.244181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.244505 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.244832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.245176 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.245533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.245863 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.246188 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.246515 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.246840 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.247417 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.247603 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.247977 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.248327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.248644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.248973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.249299 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.249622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.249943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.250261 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.250676 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.250915 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.251249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.251614 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.251953 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.252211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.252308 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.252588 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.252682 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.252924 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.253030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.253247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.253426 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.253580 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.253882 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.253975 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.254200 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.254354 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.254553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.254702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.254872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.255028 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.255204 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.255359 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.255599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.255754 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.255896 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.256049 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.256202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.256383 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.256528 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.256678 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.256859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.257025 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.257176 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.257324 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.257497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.257654 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.257831 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.257995 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.258163 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.258444 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.258598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.258750 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.258900 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.259062 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.259217 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.259359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.259567 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.259730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.260009 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.260162 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.260304 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.260454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.260602 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.260753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.260915 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.261065 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.261303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.261454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.261613 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.261833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.261995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.262145 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.262293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.262441 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.262601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.262752 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.262902 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.263050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.263191 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.263385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.263588 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.263747 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.264046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.264200 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.264364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.264512 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.264685 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.264857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.265009 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.265158 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.265328 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.265483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.265655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.265813 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.267582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.267763 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.267911 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.268053 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.268210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.268374 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.268515 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.268664 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.268664 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.268931 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.269085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.269236 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.269385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.269525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.269674 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.269813 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.269967 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.270109 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.270269 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.270421 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.270562 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.270702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.270856 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.271004 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.271145 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.271322 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.271590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.271762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.272023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.272181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.272333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.272484 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.272633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.272784 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.272927 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.272927 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.273205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.273356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.273497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.273650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.273799 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.273941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.273941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.274235 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.274388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.274530 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.274670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.274670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.274952 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.275099 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.275251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.275393 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.275595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.275746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.275887 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.276038 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.276188 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.276330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.276732 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.276875 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.276875 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.277167 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.277316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.277464 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.277606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.277753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.277893 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.278106 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.278259 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.278407 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.278549 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.278690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.278830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.278980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.279122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.279269 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.279411 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.279583 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.279742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.279891 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.280049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.280225 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.280381 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.280553 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.280758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.280919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.281072 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.281228 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.281379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.281559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.281798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.281946 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.282196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.282345 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.282487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.282694 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.282851 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.283557 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.283710 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.283853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.284003 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.284186 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.284525 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.284842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.284988 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.285141 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.285290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.285470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.285619 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.285788 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.285944 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.286095 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.286327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.286527 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.286681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.286833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.286976 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.287116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.287322 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.287542 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.287690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.287950 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.288128 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.288384 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.288541 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.288704 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.288852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.289059 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.289227 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.289370 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.289537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.289687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.289836 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.290114 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.290264 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.290449 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.290596 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.290767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.290915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.291082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.291258 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.291422 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.291614 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.291785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.292011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.292177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.292404 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.292566 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.292710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.292859 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.293001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.293151 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.293295 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.293444 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.293598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.293864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.294011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.294202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.294366 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.294508 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.294770 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.294918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.295118 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.295274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.295429 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.295611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.295762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.295911 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.296063 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.296212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.296367 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.296510 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.296677 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.296826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.296981 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.297139 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.297306 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.297482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.297634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.297774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.297914 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.298078 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.298220 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.298360 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.298509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.298706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.298855 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.299010 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.299160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.299301 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.299516 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.299676 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.299825 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.299980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.300143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.300285 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.300451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.300774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.300922 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.301198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.301345 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.302098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.302265 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.302424 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.302672 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.302820 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.302990 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.303133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.303280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.303574 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.303741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.303961 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.304115 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.304293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.304443 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.304643 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.304805 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.304984 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.305210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.305376 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.305557 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.305715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.305867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.306030 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.306217 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.306368 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.306518 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.306673 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.306816 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.306958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.307166 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.307327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.307515 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.307776 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.308050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.308198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.308394 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.308549 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.308695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.308844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.308993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.309177 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.309326 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.309526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.309793 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.309960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.310103 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.310244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.310384 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.310538 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.310765 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.310909 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.311051 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.311201 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.311343 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.311509 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.311683 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.311828 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.311977 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.312119 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.312374 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.312536 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.312785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.312940 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.313082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.313224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.313365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.313534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.313679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.313830 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.313982 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.314314 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.314474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.314632 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.314991 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.315146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.315381 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.315568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.315726 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.315869 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.316047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.316222 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.316367 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.316516 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.316668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.316810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.316999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.317147 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.317331 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.317480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.317638 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.317788 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.318547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.318697 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.318904 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.319181 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.319346 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.319571 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.319571 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.319870 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.320013 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.320152 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.320152 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.320440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.320440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.320752 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.320902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.320902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.321178 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.321329 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.321329 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.321607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.321747 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.321887 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.322028 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.322177 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.322365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.322365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.322767 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.323036 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.323186 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.323342 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.323342 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.323720 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.323871 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.324032 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.324183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.324183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.324507 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.324664 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121268) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 17:04:42.324820 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.325120 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.325433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.325746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.326063 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.326443 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.326691 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.327001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.327312 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.327652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.327998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.328341 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.328663 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.328995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.329316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.329645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.330000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.330333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.330661 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.330991 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.331318 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.331810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.332135 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.332614 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.332996 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.333086 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.333392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.333712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.334050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.334399 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.334705 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.335041 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.335400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.335730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.336052 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.336373 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.336710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.337030 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.337347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.337663 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.338031 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.338299 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.338620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.338940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.339257 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.339612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.339937 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.340274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.340604 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.340962 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.341276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.341586 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.341936 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.342252 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.342607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.342952 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.343273 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.343768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.343944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 17:04:42.344369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121267) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 17:04:42.388973 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO dbcounter [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Registered counter for database nova_api Aug 18 17:04:42.406779 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO dbcounter [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Registered counter for database nova_api Aug 18 17:04:42.411516 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:04:42.418678 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writer thread running {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:04:42.429663 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_db.sqlalchemy.engines [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:04:42.435746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writer thread running {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:04:42.476674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.context [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d85d2796-38a5-4d76-99fb-481c052ce6b5(cell1) {{(pid=121268) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 17:04:42.480747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:04:42.481229 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:04:42.482810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:04:42.483590 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:04:42.484044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:04:42.486036 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:04:42.488242 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO dbcounter [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Registered counter for database nova_cell0 Aug 18 17:04:42.492097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.context [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),d85d2796-38a5-4d76-99fb-481c052ce6b5(cell1) {{(pid=121267) load_cells /opt/stack/nova/nova/context.py:464}} Aug 18 17:04:42.492300 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO dbcounter [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Registered counter for database nova_cell1 Aug 18 17:04:42.496265 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:04:42.496759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:04:42.498363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:04:42.499122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:04:42.499612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:04:42.501064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:04:42.501669 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:04:42.502789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:04:42.504322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO dbcounter [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Registered counter for database nova_cell0 Aug 18 17:04:42.508331 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writer thread running {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:04:42.508468 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO dbcounter [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Registered counter for database nova_cell1 Aug 18 17:04:42.514047 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writer thread running {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:04:42.515798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_db.sqlalchemy.engines [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:04:42.518560 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_db.sqlalchemy.engines [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:04:42.524111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writer thread running {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:04:42.525725 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writer thread running {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:04:42.669711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO dbcounter [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Registered counter for database nova_cell0 Aug 18 17:04:42.677400 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_db.sqlalchemy.engines [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121268) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:04:42.679060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO dbcounter [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Registered counter for database nova_cell0 Aug 18 17:04:42.681855 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writer thread running {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:04:42.686127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_db.sqlalchemy.engines [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121267) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 17:04:42.691069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writer thread running {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 17:04:43.009965 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: WARNING keystonemiddleware.auth_token [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:04:43.017153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: WARNING keystonemiddleware.auth_token [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:04:43.017461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: WARNING keystonemiddleware.auth_token [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:04:43.024776 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: WARNING keystonemiddleware.auth_token [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:04:43.367267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: WARNING keystonemiddleware.auth_token [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:04:43.374173 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: WARNING keystonemiddleware.auth_token [None req-dd5da727-fe18-4fd0-afbe-1371404652fe None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:04:43.377116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: WARNING keystonemiddleware.auth_token [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 18 17:04:43.379564 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560df940e9c0 pid: 121268 (default app) Aug 18 17:04:43.383195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: WARNING keystonemiddleware.auth_token [None req-1162dcca-202d-49d6-b502-1b6bd70d14c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 18 17:04:43.388588 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560df940e9c0 pid: 121267 (default app) Aug 18 17:05:20.206203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.210376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.210376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.217844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.393362 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=3 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.396657 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=3 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.401090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=3 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:20.401090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=3 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4e7c64ec-42b8-4ddf-8438-2ca8097451d9 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Action: 'create', calling method: .version_select at 0x7ff5b6d51550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1767826571", "metadata": {"Type": "work"}}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4e7c64ec-42b8-4ddf-8438-2ca8097451d9 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Request method failure captured: Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 122 Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFQFoH9-3fH4LLbKeEhQWYTEJ2-c87g3PihCqdVuhf5sLIP2LF7H4v_FU6Xg2ncuGrbxqjDmMFXeTOFIvQvLnJUudrmCa_i7EJHHVFqgaKkVwFCie04tqOQqOIt428PnM8KeOiJZEzlD99oR0AW-xr-k49SQV-cmiJXI5tqSQfCPCs Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:05:21.590451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aebd95c8078848f0b947de8e8383e37b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 383d8d993f4e4bafabcae775f86d31e9 Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1767826571", "metadata": {"Type": "work"}}} Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: Aug 18 17:05:21.592570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1767826571', 'metadata': {'Type': 'work'}}}} Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise error Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi '#$%' Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:21.594042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 17:05:21.595771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 17:05:21.597205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 18 17:05:21.597205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:21.597205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4e7c64ec-42b8-4ddf-8438-2ca8097451d9 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:21.597205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4e7c64ec-42b8-4ddf-8438-2ca8097451d9 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.403082 Aug 18 17:05:21.597205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1156 bytes} [Thu Aug 18 17:05:20 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1406 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:05:21.842796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-549c5d39-a9c3-4031-a10c-b512dac8d06b tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] Action: 'create', calling method: .version_select at 0x7ff5b6d515e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-116966068", "metadata": {"Type": "work"}}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:21.949658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a1818511-042a-476a-9049-c5e7bca370c7 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Action: 'create', calling method: .version_select at 0x7ff5b6d514c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-914307952"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:24.251767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a1818511-042a-476a-9049-c5e7bca370c7 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.880104 Aug 18 17:05:24.253751 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 1/2] 10.222.0.78 () {60 vars in 1155 bytes} [Thu Aug 18 17:05:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3884 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 17:05:24.261361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f0a188b4-94e9-462c-93d5-bdc5cdb45344 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Action: 'create', calling method: .version_select at 0x7ff5b6c24310>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1766538617", "metadata": {"Type": "work"}}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f0a188b4-94e9-462c-93d5-bdc5cdb45344 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Request method failure captured: Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 120 Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFQFoH9-3fH4LLbKeEhQWYTEJ2-c87g3PihCqdVuhf5sLIP2LF7H4v_FU6Xg2ncuGrbxqjDmMFXeTOFIvQvLnJUudrmCa_i7EJHHVFqgaKkVwFCie04tqOQqOIt428PnM8KeOiJZEzlD99oR0AW-xr-k49SQV-cmiJXI5tqSQfCPCs Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:05:24.281490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aebd95c8078848f0b947de8e8383e37b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 383d8d993f4e4bafabcae775f86d31e9 Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1766538617", "metadata": {"Type": "work"}}} Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: Aug 18 17:05:24.282454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1766538617', 'metadata': {'Type': 'work'}}}} Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise error Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi '0' Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:24.283064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 17:05:24.284102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 17:05:24.284894 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 18 17:05:24.284894 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.290287 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f0a188b4-94e9-462c-93d5-bdc5cdb45344 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:24.292451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f0a188b4-94e9-462c-93d5-bdc5cdb45344 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.037125 Aug 18 17:05:24.293013 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 2/3] 10.222.0.78 () {60 vars in 1156 bytes} [Thu Aug 18 17:05:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:05:24.313378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8abcfad4-4d7b-478a-9edb-4f8dd35e7f85 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6c38d30>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:24.368055 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-549c5d39-a9c3-4031-a10c-b512dac8d06b tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 2.774702 Aug 18 17:05:24.369465 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 2/4] 10.222.0.78 () {60 vars in 1156 bytes} [Thu Aug 18 17:05:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 2778 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 18 17:05:24.375914 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-941c626f-1c6c-43fc-9096-c6cc126d12fc tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Action: 'create', calling method: .version_select at 0x7ff5b6bdf940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1287165178", "metadata": {"Type": "work"}}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-941c626f-1c6c-43fc-9096-c6cc126d12fc tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Request method failure captured: Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 119 Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFQFoH9-3fH4LLbKeEhQWYTEJ2-c87g3PihCqdVuhf5sLIP2LF7H4v_FU6Xg2ncuGrbxqjDmMFXeTOFIvQvLnJUudrmCa_i7EJHHVFqgaKkVwFCie04tqOQqOIt428PnM8KeOiJZEzlD99oR0AW-xr-k49SQV-cmiJXI5tqSQfCPCs Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:05:24.382509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aebd95c8078848f0b947de8e8383e37b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 383d8d993f4e4bafabcae775f86d31e9 Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1287165178", "metadata": {"Type": "work"}}} Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: Aug 18 17:05:24.383978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1287165178', 'metadata': {'Type': 'work'}}}} Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise error Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi '' Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:24.384607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 18 17:05:24.385556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 18 17:05:24.386371 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 18 17:05:24.386371 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.393795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-941c626f-1c6c-43fc-9096-c6cc126d12fc tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:24.396957 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-941c626f-1c6c-43fc-9096-c6cc126d12fc tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023880 Aug 18 17:05:24.399543 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 3/5] 10.222.0.78 () {60 vars in 1156 bytes} [Thu Aug 18 17:05:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:05:24.411493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f70f9c36-49c3-4e21-9464-ddb6adb3a12f tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] Calling method '.version_select at 0x7ff5b6d0b310>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:24.459285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8abcfad4-4d7b-478a-9edb-4f8dd35e7f85 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da" status: 200 len: 344 microversion: 2.1 time: 0.164546 Aug 18 17:05:24.465665 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 3/6] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:24 2022] GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da => generated 344 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:24.469559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1a8cfd1f-fc8e-440d-8c31-00dbae6f1811 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Calling method '.version_select at 0x7ff5b6c38a60>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:24.512770 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f70f9c36-49c3-4e21-9464-ddb6adb3a12f tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994" status: 200 len: 352 microversion: 2.1 time: 0.113002 Aug 18 17:05:24.513824 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 4/7] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:24 2022] GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994 => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:24.541423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-1a8cfd1f-fc8e-440d-8c31-00dbae6f1811 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] HTTP exception thrown: Volume tempest-invalid-1132050953 could not be found. Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1a8cfd1f-fc8e-440d-8c31-00dbae6f1811 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Request method failure captured: Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1132050953 HTTP/1.1 Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFQFoH9-3fH4LLbKeEhQWYTEJ2-c87g3PihCqdVuhf5sLIP2LF7H4v_FU6Xg2ncuGrbxqjDmMFXeTOFIvQvLnJUudrmCa_i7EJHHVFqgaKkVwFCie04tqOQqOIt428PnM8KeOiJZEzlD99oR0AW-xr-k49SQV-cmiJXI5tqSQfCPCs Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:05:24.545159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aebd95c8078848f0b947de8e8383e37b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 383d8d993f4e4bafabcae775f86d31e9 Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Volume tempest-invalid-1132050953 could not be found. Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': 'tempest-invalid-1132050953'} Aug 18 17:05:24.546650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1132050953 could not be found. (HTTP 404) (Request-ID: req-9b08a44f-ce37-4073-a5cd-6a648725a45a) Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.547237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:05:24.548629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1132050953 could not be found. Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:05:24.551675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1132050953 could not be found. Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1132050953 could not be found. Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1a8cfd1f-fc8e-440d-8c31-00dbae6f1811 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Returning 404 to user: Volume tempest-invalid-1132050953 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1a8cfd1f-fc8e-440d-8c31-00dbae6f1811 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1132050953" status: 404 len: 99 microversion: 2.1 time: 0.085201 Aug 18 17:05:24.552566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 4/8] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Aug 18 17:05:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1132050953 => generated 99 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 18 17:05:24.556658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-bbd6112c-b1b0-40c6-9387-01601e0b0618 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003865 Aug 18 17:05:24.557427 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 5/9] 10.222.0.78 () {58 vars in 1140 bytes} [Thu Aug 18 17:05:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 17:05:24.568145 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-388ab884-bfde-4964-b34b-6ad0178c4897 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005671 Aug 18 17:05:24.568864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 5/10] 10.222.0.78 () {58 vars in 1137 bytes} [Thu Aug 18 17:05:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 18 17:05:24.580499 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fa343c30-5881-498f-b572-2b68ef4fd3b4 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Calling method '.version_select at 0x7ff5b6bf43a0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:24.658274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-fa343c30-5881-498f-b572-2b68ef4fd3b4 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] HTTP exception thrown: Volume ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0 could not be found. Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fa343c30-5881-498f-b572-2b68ef4fd3b4 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Request method failure captured: Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: DELETE /compute/v2.1/os-volumes/ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0 HTTP/1.1 Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFQFoH9-3fH4LLbKeEhQWYTEJ2-c87g3PihCqdVuhf5sLIP2LF7H4v_FU6Xg2ncuGrbxqjDmMFXeTOFIvQvLnJUudrmCa_i7EJHHVFqgaKkVwFCie04tqOQqOIt428PnM8KeOiJZEzlD99oR0AW-xr-k49SQV-cmiJXI5tqSQfCPCs Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:05:24.661795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aebd95c8078848f0b947de8e8383e37b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 383d8d993f4e4bafabcae775f86d31e9 Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Volume ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0 could not be found. Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': 'ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0'} Aug 18 17:05:24.662776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0 could not be found. (HTTP 404) (Request-ID: req-42b8fede-7dcc-4e8e-8270-d4babe86976c) Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.663364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:05:24.664866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0 could not be found. Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 17:05:24.667773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0 could not be found. Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0 could not be found. Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fa343c30-5881-498f-b572-2b68ef4fd3b4 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Returning 404 to user: Volume ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fa343c30-5881-498f-b572-2b68ef4fd3b4 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0" status: 404 len: 109 microversion: 2.1 time: 0.087541 Aug 18 17:05:24.668658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 6/11] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:05:24 2022] DELETE /compute/v2.1/os-volumes/ce28633a-4c5b-45bf-a9ff-2fc1bdb3d9a0 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:05:24.674576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-01a6cc8e-ea82-4ddc-8c48-6ca0b893f427 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Calling method '.version_select at 0x7ff5b6c38940>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:24.721555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-01a6cc8e-ea82-4ddc-8c48-6ca0b893f427 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] HTTP exception thrown: Volume 618ad3aa-e4bc-4050-918b-cddd79aefd7d could not be found. Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-01a6cc8e-ea82-4ddc-8c48-6ca0b893f427 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Request method failure captured: Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/os-volumes/618ad3aa-e4bc-4050-918b-cddd79aefd7d HTTP/1.1 Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFQFoH9-3fH4LLbKeEhQWYTEJ2-c87g3PihCqdVuhf5sLIP2LF7H4v_FU6Xg2ncuGrbxqjDmMFXeTOFIvQvLnJUudrmCa_i7EJHHVFqgaKkVwFCie04tqOQqOIt428PnM8KeOiJZEzlD99oR0AW-xr-k49SQV-cmiJXI5tqSQfCPCs Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:05:24.723352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/aebd95c8078848f0b947de8e8383e37b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_aebd95c8078848f0b947de8e8383e37b", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: aebd95c8078848f0b947de8e8383e37b Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-VolumesNegativeTest-2131917577 Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 383d8d993f4e4bafabcae775f86d31e9 Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-VolumesNegativeTest-2131917577-project Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Volume 618ad3aa-e4bc-4050-918b-cddd79aefd7d could not be found. Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '618ad3aa-e4bc-4050-918b-cddd79aefd7d'} Aug 18 17:05:24.724658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 618ad3aa-e4bc-4050-918b-cddd79aefd7d could not be found. (HTTP 404) (Request-ID: req-e2e9abf9-c1bb-4399-aa44-cbcd03e14e17) Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.725389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:24.726487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 618ad3aa-e4bc-4050-918b-cddd79aefd7d could not be found. Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 17:05:24.727553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 618ad3aa-e4bc-4050-918b-cddd79aefd7d could not be found. Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 618ad3aa-e4bc-4050-918b-cddd79aefd7d could not be found. Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-01a6cc8e-ea82-4ddc-8c48-6ca0b893f427 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] Returning 404 to user: Volume 618ad3aa-e4bc-4050-918b-cddd79aefd7d could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-01a6cc8e-ea82-4ddc-8c48-6ca0b893f427 tempest-VolumesNegativeTest-2131917577 tempest-VolumesNegativeTest-2131917577-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/618ad3aa-e4bc-4050-918b-cddd79aefd7d" status: 404 len: 109 microversion: 2.1 time: 0.055878 Aug 18 17:05:24.728427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 6/12] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:24 2022] GET /compute/v2.1/os-volumes/618ad3aa-e4bc-4050-918b-cddd79aefd7d => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:05:25.475582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5bdbc31c-21e7-4572-8af3-326686c51fc4 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bdfa60>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:25.536055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b1735da9-8c96-47e5-92bd-3a6b245a95c3 tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] Calling method '.version_select at 0x7ff5b6bc1670>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:25.610217 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5bdbc31c-21e7-4572-8af3-326686c51fc4 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da" status: 200 len: 345 microversion: 2.1 time: 0.140604 Aug 18 17:05:25.611257 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 7/13] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:25 2022] GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da => generated 345 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:25.624988 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ed845ee3-6b38-4a9b-b3be-5c217dd9e620 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Action: 'create', calling method: .version_select at 0x7ff5b6b9bb80>, body: {"snapshot": {"volume_id": "1fa3ba09-b7b0-4ed6-a620-5e59196c38da", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-988078812"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:25.698150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b1735da9-8c96-47e5-92bd-3a6b245a95c3 tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994" status: 200 len: 353 microversion: 2.1 time: 0.174221 Aug 18 17:05:25.698727 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 7/14] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:25 2022] GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994 => generated 353 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:25.711932 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9796baf1-8f1b-42a5-a6d0-6c9b85050ebe tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] Calling method '.version_select at 0x7ff5b6c38dc0>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:25.824902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9796baf1-8f1b-42a5-a6d0-6c9b85050ebe tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994" status: 200 len: 353 microversion: 2.1 time: 0.116627 Aug 18 17:05:25.827773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 8/15] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:25 2022] GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994 => generated 353 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:25.850415 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ee5289b5-10ba-4bdd-97d9-41e898647fbd tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] Calling method '.version_select at 0x7ff5b6bc10d0>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:26.222555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ee5289b5-10ba-4bdd-97d9-41e898647fbd tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994" status: 202 len: 0 microversion: 2.1 time: 0.375060 Aug 18 17:05:26.224094 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 9/16] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:05:25 2022] DELETE /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:05:26.233599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-41b53e6a-460e-4586-8c2c-92f16f40a295 tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] Calling method '.version_select at 0x7ff5b6bc15e0>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:26.378183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-41b53e6a-460e-4586-8c2c-92f16f40a295 tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994" status: 200 len: 352 microversion: 2.1 time: 0.149421 Aug 18 17:05:26.378928 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 10/17] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:26 2022] GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994 => generated 352 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:05:26.811959 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ed845ee3-6b38-4a9b-b3be-5c217dd9e620 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.190807 Aug 18 17:05:26.814734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 8/18] 10.222.0.78 () {60 vars in 1162 bytes} [Thu Aug 18 17:05:25 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:05:26.830683 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-63369e53-e369-4324-a1fb-ce82006ba0b9 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6c38f70>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:27.026166 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-63369e53-e369-4324-a1fb-ce82006ba0b9 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad" status: 200 len: 286 microversion: 2.1 time: 0.205790 Aug 18 17:05:27.026856 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 11/19] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Aug 18 17:05:26 2022] GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad => generated 286 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:05:27.041019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-70fe2630-3335-4f23-b3d2-80b075e6bf56 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bf9160>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:27.126768 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-70fe2630-3335-4f23-b3d2-80b075e6bf56 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.092315 Aug 18 17:05:27.136098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 9/20] 10.222.0.78 () {58 vars in 1140 bytes} [Thu Aug 18 17:05:27 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:27.146413 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d7681aed-8af7-4457-b26c-ddb5bbf16ac8 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bc1ca0>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:27.197407 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d7681aed-8af7-4457-b26c-ddb5bbf16ac8 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad" status: 200 len: 286 microversion: 2.1 time: 0.056365 Aug 18 17:05:27.197407 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 12/21] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Aug 18 17:05:27 2022] GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad => generated 286 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:27.396235 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4512c366-d491-4db2-b6c6-e008ba4454cc tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] Calling method '.version_select at 0x7ff5b6bc9430>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:27.456729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-4512c366-d491-4db2-b6c6-e008ba4454cc tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] HTTP exception thrown: Volume 6e122bc2-beca-48f7-88c8-4bf45871b994 could not be found. Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4512c366-d491-4db2-b6c6-e008ba4454cc tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] Request method failure captured: Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994 HTTP/1.1 Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFQcsaV5l3jLKZaUvpglt1EcmNkhsRtN-kPTGUe3Ek0TTQdWtesSSSvzSWUAii8-gqKm--9tbpto8lbnCQLnatn7C5r6yVS2GloKVn3PugM8ynWq2uB47Zs5JZbWJxbKuXJT0In15siod5H1WlC1FK_2HYVjpJ2Ne7_bONHNc-0HoI Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: ef22d9ec1d6648aaab439a70e6517144 Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesGetTestJSON-409902861 Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:05:27.466896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ef22d9ec1d6648aaab439a70e6517144"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ef22d9ec1d6648aaab439a70e6517144"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ef22d9ec1d6648aaab439a70e6517144"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ef22d9ec1d6648aaab439a70e6517144", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesGetTestJSON-409902861 Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: ef22d9ec1d6648aaab439a70e6517144 Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesGetTestJSON-409902861 Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesGetTestJSON-409902861-project Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 07fbd95e8c754bbab14664584d6fe370 Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesGetTestJSON-409902861-project Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Volume 6e122bc2-beca-48f7-88c8-4bf45871b994 could not be found. Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '6e122bc2-beca-48f7-88c8-4bf45871b994'} Aug 18 17:05:27.468066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6e122bc2-beca-48f7-88c8-4bf45871b994 could not be found. (HTTP 404) (Request-ID: req-bfed95f6-22a5-4810-856e-a3338cd8425e) Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:27.469243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:27.470099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6e122bc2-beca-48f7-88c8-4bf45871b994 could not be found. Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 17:05:27.475000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6e122bc2-beca-48f7-88c8-4bf45871b994 could not be found. Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6e122bc2-beca-48f7-88c8-4bf45871b994 could not be found. Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4512c366-d491-4db2-b6c6-e008ba4454cc tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] Returning 404 to user: Volume 6e122bc2-beca-48f7-88c8-4bf45871b994 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4512c366-d491-4db2-b6c6-e008ba4454cc tempest-VolumesGetTestJSON-409902861 tempest-VolumesGetTestJSON-409902861-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994" status: 404 len: 109 microversion: 2.1 time: 0.079922 Aug 18 17:05:27.476555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 10/22] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:27 2022] GET /compute/v2.1/os-volumes/6e122bc2-beca-48f7-88c8-4bf45871b994 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:05:28.208537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0a0473b9-368e-4dfd-ba51-4e960bbee63f tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bc1820>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:28.300570 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0a0473b9-368e-4dfd-ba51-4e960bbee63f tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad" status: 200 len: 286 microversion: 2.1 time: 0.098117 Aug 18 17:05:28.302025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 13/23] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Aug 18 17:05:28 2022] GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad => generated 286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:29.316611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5951d4c6-88c8-4ef6-8666-43d50e9c830d tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bf95e0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:29.369569 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5951d4c6-88c8-4ef6-8666-43d50e9c830d tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad" status: 200 len: 286 microversion: 2.1 time: 0.059520 Aug 18 17:05:29.370750 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 11/24] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Aug 18 17:05:29 2022] GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:30.382777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-923e3a8c-cf7f-4233-9c37-57fe2464d694 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bcd040>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:30.440507 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-923e3a8c-cf7f-4233-9c37-57fe2464d694 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad" status: 200 len: 287 microversion: 2.1 time: 0.061195 Aug 18 17:05:30.451043 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 14/25] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Aug 18 17:05:30 2022] GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:30.459813 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-33977171-704d-4272-a09c-af9593d947e3 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bf41f0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:30.720625 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-33977171-704d-4272-a09c-af9593d947e3 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad" status: 202 len: 0 microversion: 2.1 time: 0.267537 Aug 18 17:05:30.721660 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 12/26] 10.222.0.78 () {58 vars in 1254 bytes} [Thu Aug 18 17:05:30 2022] DELETE /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:05:30.730074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a0ad6011-5d52-4838-b005-c4fba99f448c tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bf9280>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:30.773538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a0ad6011-5d52-4838-b005-c4fba99f448c tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad" status: 200 len: 286 microversion: 2.1 time: 0.047637 Aug 18 17:05:30.774133 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 13/27] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Aug 18 17:05:30 2022] GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:05:31.088078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6917fe15-ba19-4b24-bb98-26cb2a5ca13f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'create', calling method: .version_select at 0x7ff5b6bc1160>, body: {"keypair": {"name": "tempest-keypair-702112635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsP/UvlAF5Q36wAN0K/6zlLO790zv6LMQQW3aGilRSbdZ/akLc3AtVMRJ4WRuR5hLjuBqBehHD2GEABVAxkSEOzHBjyxhWsrxR6d+Qm5Ya5pfhEWqU5/Qo0PeETWJjB+Q=="}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:31.183181 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-6917fe15-ba19-4b24-bb98-26cb2a5ca13f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Getting quotas for project 697adc4a3b0f40ff85d6b415b6bbbefd. Resources: {'key_pairs'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:05:31.197523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-6917fe15-ba19-4b24-bb98-26cb2a5ca13f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Getting quotas for user 1fa85bec641f4c2391af50d66339d9fe and project 697adc4a3b0f40ff85d6b415b6bbbefd. Resources: {'key_pairs'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:05:31.398473 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6917fe15-ba19-4b24-bb98-26cb2a5ca13f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.774740 Aug 18 17:05:31.399412 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 15/28] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Aug 18 17:05:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 776 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Aug 18 17:05:31.786703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-398ddb17-081e-43a3-9c49-4f27161a426b tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bf9dc0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:31.831519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-398ddb17-081e-43a3-9c49-4f27161a426b tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] HTTP exception thrown: Snapshot 5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad could not be found. Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-398ddb17-081e-43a3-9c49-4f27161a426b tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Request method failure captured: Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad HTTP/1.1 Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFQyyQHMIeHvaCVJ30WwqRVcqs5TU7SRTtMN2sRtrzjBUhltA1QOUqoaP4k3IPUO6aiopUZEx4lap3faqyZ3e1c3f86J5BYl6lb_DL0s2gkX5NMT6BR3jhnLGt2JvpcrOWG-ZQZuVtaFbnF7SVjbvmCQMjS1upFDJWN_Knb3iArqoI Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 4680c312b7f44f968bddfaf257bd16d9 Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:05:31.833802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4680c312b7f44f968bddfaf257bd16d9", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 4680c312b7f44f968bddfaf257bd16d9 Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesSnapshotsTestJSON-1438985654-project Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 4c0610d1a1834651a2b51ac7d91df71c Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1438985654-project Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Snapshot 5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad could not be found. Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad'} Aug 18 17:05:31.834862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad could not be found. (HTTP 404) (Request-ID: req-bb263674-e194-423b-a688-a199bea906ef) Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:31.835525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:31.836376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad could not be found. Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 18 17:05:31.837252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad could not be found. Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad could not be found. Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-398ddb17-081e-43a3-9c49-4f27161a426b tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Returning 404 to user: Snapshot 5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:31.838228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-398ddb17-081e-43a3-9c49-4f27161a426b tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad" status: 404 len: 111 microversion: 2.1 time: 0.052401 Aug 18 17:05:31.838826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 14/29] 10.222.0.78 () {58 vars in 1251 bytes} [Thu Aug 18 17:05:31 2022] GET /compute/v2.1/os-snapshots/5bcb0ee9-ee89-4188-ae58-ab6da3f8d6ad => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:05:31.844400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-10197449-1e3a-4171-ab81-12abf5989cb7 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6b4d1f0>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:32.191706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-10197449-1e3a-4171-ab81-12abf5989cb7 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da" status: 202 len: 0 microversion: 2.1 time: 0.350892 Aug 18 17:05:32.192233 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 16/30] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:05:31 2022] DELETE /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:05:32.209819 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3cdae586-5780-45f9-8edf-e3e756e6a4f8 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bf4430>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:32.336189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3cdae586-5780-45f9-8edf-e3e756e6a4f8 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da" status: 200 len: 344 microversion: 2.1 time: 0.139399 Aug 18 17:05:32.338763 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 15/31] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:32 2022] GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:33.308415 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-991e3524-20b1-486a-9355-92182996da41 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: .version_select at 0x7ff5b6b10940>, body: {"keypair": {"name": "tempest-keypair-1355014340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDKf39bb2QQg2aJLgdwUQg9juFu+WJpEqZWod93uudiUgN604JlXrXsLEkaVvrLeaQwG3h24syJN4ehAmPClureIa+7PHJh5l70yAutMi0GcMjVKSQAbFKFZWFAO0M2Ssw=="}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:33.354326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ceb67e5f-09f7-4b75-bcbe-5e02d6b49284 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bf98b0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:33.385796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-991e3524-20b1-486a-9355-92182996da41 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for project 4eececcd804446e49078038ab362b235. Resources: {'key_pairs'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:05:33.409669 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-991e3524-20b1-486a-9355-92182996da41 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for user 1fec6bdfe9ee4e839efaf7a1c083c31d and project 4eececcd804446e49078038ab362b235. Resources: {'key_pairs'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:05:33.436168 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-ceb67e5f-09f7-4b75-bcbe-5e02d6b49284 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] HTTP exception thrown: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ceb67e5f-09f7-4b75-bcbe-5e02d6b49284 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Request method failure captured: Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da HTTP/1.1 Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFQyyQHMIeHvaCVJ30WwqRVcqs5TU7SRTtMN2sRtrzjBUhltA1QOUqoaP4k3IPUO6aiopUZEx4lap3faqyZ3e1c3f86J5BYl6lb_DL0s2gkX5NMT6BR3jhnLGt2JvpcrOWG-ZQZuVtaFbnF7SVjbvmCQMjS1upFDJWN_Knb3iArqoI Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 4680c312b7f44f968bddfaf257bd16d9 Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:05:33.441315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4680c312b7f44f968bddfaf257bd16d9", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 4680c312b7f44f968bddfaf257bd16d9 Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesSnapshotsTestJSON-1438985654-project Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 4c0610d1a1834651a2b51ac7d91df71c Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1438985654-project Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '1fa3ba09-b7b0-4ed6-a620-5e59196c38da'} Aug 18 17:05:33.447880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. (HTTP 404) (Request-ID: req-ab2abd01-c632-4240-b174-0403b851270b) Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:33.448598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:33.449657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 17:05:33.451459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ceb67e5f-09f7-4b75-bcbe-5e02d6b49284 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Returning 404 to user: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ceb67e5f-09f7-4b75-bcbe-5e02d6b49284 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da" status: 404 len: 109 microversion: 2.1 time: 0.093230 Aug 18 17:05:33.452381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 16/32] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:33 2022] GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da => generated 109 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:05:33.467462 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8878c6cb-d0cb-4836-a80e-0eceb98e51f6 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6b9bca0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:33.538311 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-8878c6cb-d0cb-4836-a80e-0eceb98e51f6 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] HTTP exception thrown: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8878c6cb-d0cb-4836-a80e-0eceb98e51f6 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Request method failure captured: Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: DELETE /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da HTTP/1.1 Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFQyyQHMIeHvaCVJ30WwqRVcqs5TU7SRTtMN2sRtrzjBUhltA1QOUqoaP4k3IPUO6aiopUZEx4lap3faqyZ3e1c3f86J5BYl6lb_DL0s2gkX5NMT6BR3jhnLGt2JvpcrOWG-ZQZuVtaFbnF7SVjbvmCQMjS1upFDJWN_Knb3iArqoI Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 4680c312b7f44f968bddfaf257bd16d9 Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:05:33.540668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4680c312b7f44f968bddfaf257bd16d9", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 4680c312b7f44f968bddfaf257bd16d9 Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesSnapshotsTestJSON-1438985654-project Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 4c0610d1a1834651a2b51ac7d91df71c Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1438985654-project Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '1fa3ba09-b7b0-4ed6-a620-5e59196c38da'} Aug 18 17:05:33.541681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. (HTTP 404) (Request-ID: req-de1ab318-4379-4ff1-b974-e27e08329b0e) Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:33.542299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 18 17:05:33.546969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 18 17:05:33.547934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8878c6cb-d0cb-4836-a80e-0eceb98e51f6 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Returning 404 to user: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8878c6cb-d0cb-4836-a80e-0eceb98e51f6 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da" status: 404 len: 109 microversion: 2.1 time: 0.087691 Aug 18 17:05:33.548795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 17/33] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:05:33 2022] DELETE /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:05:33.553101 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-991e3524-20b1-486a-9355-92182996da41 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.962826 Aug 18 17:05:33.555498 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 17/34] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:05:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:33.558364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f649f5e5-0948-467b-be75-2ae33f991071 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Calling method '.version_select at 0x7ff5b6bf9e50>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:33.633242 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-f649f5e5-0948-467b-be75-2ae33f991071 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] HTTP exception thrown: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f649f5e5-0948-467b-be75-2ae33f991071 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Request method failure captured: Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da HTTP/1.1 Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFQyyQHMIeHvaCVJ30WwqRVcqs5TU7SRTtMN2sRtrzjBUhltA1QOUqoaP4k3IPUO6aiopUZEx4lap3faqyZ3e1c3f86J5BYl6lb_DL0s2gkX5NMT6BR3jhnLGt2JvpcrOWG-ZQZuVtaFbnF7SVjbvmCQMjS1upFDJWN_Knb3iArqoI Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 4680c312b7f44f968bddfaf257bd16d9 Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:05:33.635536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4680c312b7f44f968bddfaf257bd16d9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4680c312b7f44f968bddfaf257bd16d9", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 4680c312b7f44f968bddfaf257bd16d9 Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1438985654 Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesSnapshotsTestJSON-1438985654-project Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 4c0610d1a1834651a2b51ac7d91df71c Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1438985654-project Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '1fa3ba09-b7b0-4ed6-a620-5e59196c38da'} Aug 18 17:05:33.636577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. (HTTP 404) (Request-ID: req-be01a94a-7abf-4ae3-a4ae-2ad4a899d54e) Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:33.637204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 18 17:05:33.644867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 18 17:05:33.645872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f649f5e5-0948-467b-be75-2ae33f991071 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] Returning 404 to user: Volume 1fa3ba09-b7b0-4ed6-a620-5e59196c38da could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f649f5e5-0948-467b-be75-2ae33f991071 tempest-VolumesSnapshotsTestJSON-1438985654 tempest-VolumesSnapshotsTestJSON-1438985654-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da" status: 404 len: 109 microversion: 2.1 time: 0.088758 Aug 18 17:05:33.646777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 18/35] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:05:33 2022] GET /compute/v2.1/os-volumes/1fa3ba09-b7b0-4ed6-a620-5e59196c38da => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:05:38.457268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1795038155", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:38.668177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.network.neutron [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] validate_networks() for [('9262925b-65a7-4a9e-8370-bb0d87864ea7', None, None, None, None, None)] {{(pid=121267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:05:38.882371 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1502380423", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8be6f688-0f91-4174-bb68-fa46841659a9"}], "security_groups": [{"name": "tempest-securitygroup--664683713"}], "key_name": "tempest-keypair-702112635", "user_data": "}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:39.373679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] validate_networks() for [('8be6f688-0f91-4174-bb68-fa46841659a9', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:05:41.149993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Flavor limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:05:41.150615 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Image limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:05:41.151355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Flavor pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:05:41.151998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Image pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:05:41.152569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:05:41.162342 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:41.169132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:41.169662 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:41.171273 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:41.171919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:41.187191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:41.268947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Getting quotas for project ccc5c89023ff476ca3b85680f56f8899. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:05:41.280456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Getting quotas for user a3bc033664c445f78b9d67440876c19d and project ccc5c89023ff476ca3b85680f56f8899. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:05:41.347286 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Going to run 1 instances... {{(pid=121267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:05:41.352908 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:05:41.486094 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:05:41.486094 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:05:41.486578 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:05:41.487191 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:05:41.487748 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:05:41.514114 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:41.515397 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:41.515879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:41.516612 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:41.517074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:41.517504 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:41.549032 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Getting quotas for project 697adc4a3b0f40ff85d6b415b6bbbefd. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:05:41.558304 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Getting quotas for user 1fa85bec641f4c2391af50d66339d9fe and project 697adc4a3b0f40ff85d6b415b6bbbefd. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:05:41.572091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:05:41.574932 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:05:41.625104 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-728e358b-ad33-4674-afa3-38952ba56933 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.751438 Aug 18 17:05:41.626169 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 18/36] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:05:37 2022] POST /compute/v2.1/servers => generated 383 bytes in 3753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:05:41.762476 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f359f951-e997-466e-adf2-35c206aecb80 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.885361 Aug 18 17:05:41.763121 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 19/37] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Aug 18 17:05:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 2887 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 18 17:05:41.773693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-653790645", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c53d22-e6a6-4bb0-95db-6f41b7bca33b"}], "security_groups": [{"name": "tempest-securitygroup--515187756"}], "key_name": "tempest-keypair-1355014340", "user_data": "}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:42.113571 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] validate_networks() for [('93c53d22-e6a6-4bb0-95db-6f41b7bca33b', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:05:42.192707 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1055823749", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "networks": [{"uuid": "63680694-8a1f-4ab0-b38c-11df7b0ada7d"}]}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:42.272606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.network.neutron [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] validate_networks() for [('63680694-8a1f-4ab0-b38c-11df7b0ada7d', None, None, None, None, None)] {{(pid=121267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:05:43.117976 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:05:43.118435 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:05:43.118863 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:05:43.119288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:05:43.119716 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:05:43.134384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:43.144323 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:43.144778 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:43.145582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:43.153999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:43.154455 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:43.243204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for project 4eececcd804446e49078038ab362b235. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:05:43.257582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for user 1fec6bdfe9ee4e839efaf7a1c083c31d and project 4eececcd804446e49078038ab362b235. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:05:43.259230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Flavor limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:05:43.259708 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Image limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:05:43.260153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Flavor pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:05:43.260622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Image pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:05:43.260978 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:05:43.280873 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:43.282085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:43.283245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:43.284202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:43.284851 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:43.285505 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:43.298791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:05:43.320789 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Getting quotas for project 9fb6f2a098cb4ed4b93c4edb41ff2113. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:05:43.328352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Getting quotas for user 3a4b4ea70c454bd59246e934403d04c2 and project 9fb6f2a098cb4ed4b93c4edb41ff2113. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:05:43.328484 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:05:43.373255 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Going to run 1 instances... {{(pid=121267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:05:43.378513 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:05:43.633325 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-477a9a05-fd2a-4ebb-a1a0-783fd5f85d87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.868920 Aug 18 17:05:43.634396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 20/38] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:05:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:05:43.640587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-42ec7fc3-2277-491e-9f8b-8a160e544e30 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:43.641233 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-42ec7fc3-2277-491e-9f8b-8a160e544e30 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:43.692845 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cb2a006e-5381-454e-b65c-c7814e248e02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.062812 Aug 18 17:05:43.692845 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:05:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 2064 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:05:43.702907 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6e4010fd-447b-44ae-827f-4cb6c43ac76f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:43.703567 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6e4010fd-447b-44ae-827f-4cb6c43ac76f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:43.852581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6e4010fd-447b-44ae-827f-4cb6c43ac76f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:43.872234 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6e4010fd-447b-44ae-827f-4cb6c43ac76f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:43.874760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6e4010fd-447b-44ae-827f-4cb6c43ac76f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:43.876134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6e4010fd-447b-44ae-827f-4cb6c43ac76f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1281 microversion: 2.20 time: 0.184110 Aug 18 17:05:43.876922 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 20/40] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:43 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1281 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:05:43.882323 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6a04b5f2-2094-4a0d-855b-61062a9aa803 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:43.883867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6a04b5f2-2094-4a0d-855b-61062a9aa803 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:44.001846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6a04b5f2-2094-4a0d-855b-61062a9aa803 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:44.009276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6a04b5f2-2094-4a0d-855b-61062a9aa803 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1241 microversion: 2.1 time: 0.130407 Aug 18 17:05:44.009884 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 21/41] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:43 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1241 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:44.018987 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-42ec7fc3-2277-491e-9f8b-8a160e544e30 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:44.032087 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6625a955-8da1-410a-8018-333760987421 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:44.033357 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6625a955-8da1-410a-8018-333760987421 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:44.070215 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-42ec7fc3-2277-491e-9f8b-8a160e544e30 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1222 microversion: 2.1 time: 0.434702 Aug 18 17:05:44.084085 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 21/42] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:43 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1222 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:44.157489 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6625a955-8da1-410a-8018-333760987421 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:44.184789 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6625a955-8da1-410a-8018-333760987421 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1215 microversion: 2.1 time: 0.165892 Aug 18 17:05:44.194093 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 22/43] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:44 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1215 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:44.296597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-147989543", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:44.451049 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] validate_networks() for [('9262925b-65a7-4a9e-8370-bb0d87864ea7', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:05:44.902518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-934c8c28-c36b-461c-9158-dbbfd86eee1e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:44.903298 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-934c8c28-c36b-461c-9158-dbbfd86eee1e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:45.077582 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-934c8c28-c36b-461c-9158-dbbfd86eee1e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:45.090105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-934c8c28-c36b-461c-9158-dbbfd86eee1e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:45.094777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-934c8c28-c36b-461c-9158-dbbfd86eee1e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:45.099231 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-934c8c28-c36b-461c-9158-dbbfd86eee1e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1281 microversion: 2.20 time: 0.199423 Aug 18 17:05:45.099971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:44 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1281 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:05:45.121023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fb55d24e-1754-4735-ac9d-cd9bdbb49e26 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:45.122010 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fb55d24e-1754-4735-ac9d-cd9bdbb49e26 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:45.204690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:05:45.205326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:05:45.205956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:05:45.206638 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:05:45.207104 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:05:45.224376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:45.225676 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:45.226329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:45.227841 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:45.228513 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:45.229516 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:45.233490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fb55d24e-1754-4735-ac9d-cd9bdbb49e26 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:45.243786 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fb55d24e-1754-4735-ac9d-cd9bdbb49e26 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1241 microversion: 2.1 time: 0.126498 Aug 18 17:05:45.244386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 24/45] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:45 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1241 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:45.250884 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c9bb3e4a-547a-4db2-8918-80b443acdb8d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:45.251548 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c9bb3e4a-547a-4db2-8918-80b443acdb8d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:45.265054 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Getting quotas for project ccc5c89023ff476ca3b85680f56f8899. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:05:45.270968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Getting quotas for user a3bc033664c445f78b9d67440876c19d and project ccc5c89023ff476ca3b85680f56f8899. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:05:45.286717 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:05:45.291640 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:05:45.333737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c9bb3e4a-547a-4db2-8918-80b443acdb8d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:45.344594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c9bb3e4a-547a-4db2-8918-80b443acdb8d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1215 microversion: 2.1 time: 0.097892 Aug 18 17:05:45.347725 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 25/46] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:45 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1215 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:45.540568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9d4aa40c-c97d-4987-a36e-78ad5c790ccc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.250385 Aug 18 17:05:45.541558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 22/47] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:05:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 1252 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:05:45.552466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ad396fb5-f643-4d52-b23c-5ccb14719b2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:45.553181 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ad396fb5-f643-4d52-b23c-5ccb14719b2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:45.621707 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ad396fb5-f643-4d52-b23c-5ccb14719b2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:45.647987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ad396fb5-f643-4d52-b23c-5ccb14719b2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1221 microversion: 2.1 time: 0.094063 Aug 18 17:05:45.651599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 26/48] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:45 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:46.126026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:46.128923 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:46.144282 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:46.145463 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:46.146917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:46.148029 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:46.150665 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:46.151656 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:46.269397 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:46.270838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:46.284050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:46.284768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:46.286711 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:46.287778 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:46.291043 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:46.291923 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:46.408415 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:46.463590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:46.472309 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:46.479839 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-51e30f65-a935-482a-afd9-46b31d1bb858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1245 microversion: 2.1 time: 0.215851 Aug 18 17:05:46.479954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:46.481092 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 27/49] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:46 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1245 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:05:46.487569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:46.488490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:46.496747 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:46.497589 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:46.498222 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:46.499766 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:46.500197 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b1e1a85b-4768-446e-bddc-5b59afd886c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1277 microversion: 2.20 time: 0.380535 Aug 18 17:05:46.500709 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:46.502430 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:46.513387 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 23/50] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:46 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1277 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:05:46.589733 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:46.598260 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4899cc54-fdb3-4ef9-a4f3-1f20973baedb tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1219 microversion: 2.1 time: 0.115895 Aug 18 17:05:46.599177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 28/51] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:46 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1219 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:46.673353 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a741e333-3f9a-4b9f-9bcb-4d1543b6b18c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:46.674628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a741e333-3f9a-4b9f-9bcb-4d1543b6b18c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:46.769454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a741e333-3f9a-4b9f-9bcb-4d1543b6b18c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:46.780534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a741e333-3f9a-4b9f-9bcb-4d1543b6b18c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1221 microversion: 2.1 time: 0.111080 Aug 18 17:05:46.781674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 24/52] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:46 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1221 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:47.518887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:47.519640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:47.528351 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:47.529042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:47.541227 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:47.541503 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:47.541760 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:47.542002 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:47.542441 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:47.543147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:47.549501 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:47.554712 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:47.555117 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:47.555621 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:47.556192 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:47.556646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:47.673090 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:47.715187 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:47.724476 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:47.730950 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f9ab96bc-e45a-428a-a16f-1c8b3d0f9c98 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1341 microversion: 2.20 time: 0.201905 Aug 18 17:05:47.731653 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 25/53] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:47 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1341 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:05:47.747761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:47.750222 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:47.777016 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:47.784281 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:47.785842 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:47.787362 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:47.787884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:47.797407 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:48.002228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:48.021360 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6c415635-d4e6-4fb1-9aba-6aa491ca3d91 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1267 microversion: 2.1 time: 0.285704 Aug 18 17:05:48.024632 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 26/54] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:47 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1267 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:48.049799 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:48.052158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:48.064850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:48.067211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:48.067211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:48.069206 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:48.073125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:48.073652 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:48.095052 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:48.105929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-71a2c7c5-196b-4d2f-97f8-18211c1cfee8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1293 microversion: 2.1 time: 0.594026 Aug 18 17:05:48.108668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 29/55] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:47 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1293 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:48.190431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:48.199563 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d10eb924-8806-4438-97ef-80aa620cfec6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1273 microversion: 2.1 time: 0.159104 Aug 18 17:05:48.200176 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 27/56] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:48 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1273 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:48.763055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:48.764409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:48.778245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:48.780872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:48.781477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:48.782366 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:48.790230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:48.790952 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:48.992530 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:49.022781 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:49.024651 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:49.041990 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2bc18df6-049b-4a40-8ec6-bb601882b2db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1339 microversion: 2.20 time: 0.287038 Aug 18 17:05:49.046859 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:49.047464 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 30/57] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:48 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1339 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:05:49.048298 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:49.063344 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:49.071420 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:49.074244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:49.074244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:49.074244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:49.074244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:49.135402 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:49.136560 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:49.150715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:49.152093 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:49.152551 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:49.156742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:49.159652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:49.161227 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:49.284010 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:49.294687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7e471926-d69a-49ea-9f63-2a4ab0368166 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1275 microversion: 2.1 time: 0.252175 Aug 18 17:05:49.301178 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 28/58] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:49 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1275 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:05:49.313504 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:49.314139 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:49.328256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:49.328658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:49.332858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:49.333744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:49.334403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:49.334986 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:49.386819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:49.413283 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-13e5b984-3abe-4b32-a5dc-bbc323994c71 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1301 microversion: 2.1 time: 0.282500 Aug 18 17:05:49.416484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 31/59] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:49 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1301 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:49.594533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:49.608565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-67914679-46cf-468f-bd68-705d4bf6104f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1281 microversion: 2.1 time: 0.305885 Aug 18 17:05:49.624088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 29/60] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:49 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1281 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:50.080626 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:50.088332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:50.099931 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:50.100674 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:50.101442 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:50.106202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:50.107160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:50.119575 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:50.320230 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:50.320978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:50.332986 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:50.334730 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:50.340646 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:50.341729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:50.343134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:50.343831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:50.460222 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:50.469305 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:50.476150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:50.485478 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a1926ac9-32ba-4c3f-8750-55f9ab3a6b5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1339 microversion: 2.20 time: 0.414990 Aug 18 17:05:50.491639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 32/61] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:50 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1339 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:05:50.509486 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:50.512319 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:50.547895 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:50.548456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:50.552386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:50.553183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:50.553679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:50.554127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:51.005132 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:51.025700 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b02e5492-8db1-4dff-8f17-eb71aa8f3096 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1273 microversion: 2.1 time: 0.709822 Aug 18 17:05:51.026306 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 30/62] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:50 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1273 bytes in 711 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:51.051018 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:51.052965 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:51.068847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:51.069625 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:51.071184 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:51.072651 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:51.077699 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:51.078361 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:51.226282 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:51.240514 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-30991f41-ac60-4673-91fe-e7c383cd220e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1299 microversion: 2.1 time: 0.746723 Aug 18 17:05:51.241471 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 33/63] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:50 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1299 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:51.518930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:51.523614 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:51.526910 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:51.530179 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:51.534532 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1b0c39ad-d2f8-4337-8d19-f3b110380efb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1279 microversion: 2.1 time: 0.494392 Aug 18 17:05:51.551933 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 31/64] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:51 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1279 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:51.555479 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:51.556177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:51.556772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:51.557723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:51.558385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:51.558983 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:52.075938 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:52.075938 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:52.081689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:52.081689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:52.081689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:52.081689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:52.083011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:52.083011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:52.257478 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:52.272264 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9a16bfef-1e5d-46d6-a637-76f97acb4b4a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1273 microversion: 2.1 time: 0.204526 Aug 18 17:05:52.276348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 32/65] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:52 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1273 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:52.300796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:52.300796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:52.301747 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:52.310588 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:52.312434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:52.314343 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:52.315669 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:52.318515 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:52.319130 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:52.319644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:52.404207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:52.404207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fbcc843b-9d40-499b-954a-382e40e0436f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.812803 Aug 18 17:05:52.404207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:51 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:05:52.564379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:52.565232 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:52.578347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:52.582378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:52.582943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:52.583867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:52.586001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:52.589616 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:52.918731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:52.945920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-94f42437-fd39-4125-9a5d-901c4e8bc773 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1279 microversion: 2.1 time: 0.377697 Aug 18 17:05:52.954309 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 35/67] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:52 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1279 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:53.184063 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:53.198539 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d242fae3-fa38-40af-b31c-d7dcb18f0fee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1299 microversion: 2.1 time: 0.920873 Aug 18 17:05:53.212622 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 33/68] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:52 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1299 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:53.307284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=4 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:53.313838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:53.314781 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:53.352528 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:53.359620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:53.364431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:53.365522 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:53.367784 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:53.368431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:53.395477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:53.396241 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:53.418627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:53.420481 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:53.424954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:53.428429 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:53.430615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:53.431140 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:53.662861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:53.684739 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d2a3b2b0-9778-49df-89a4-ab9422b70dbf tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1273 microversion: 2.1 time: 0.376203 Aug 18 17:05:53.702245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 36/69] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:53 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1273 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:53.971749 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:53.972619 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:53.985442 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:53.986117 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:53.986819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:53.987567 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:53.988175 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:53.989026 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:54.082560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:54.103285 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:54.108982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:54.122223 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8fe8becb-2fa6-4573-a282-0eb31a4eb8d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.719827 Aug 18 17:05:54.145833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 34/70] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:53 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:05:54.227935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:54.228618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:54.244778 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:54.245290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:54.245738 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:54.246475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:54.246935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:54.258081 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:54.775811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:54.805059 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c4802a6b-8bde-497e-9edd-a61265faed87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1299 microversion: 2.1 time: 0.584805 Aug 18 17:05:54.823642 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 35/71] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:54 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1299 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:05:54.844746 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:54.845715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:54.858640 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:54.859424 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:54.862629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:54.872835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:54.873685 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:54.874302 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:55.044732 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:55.054031 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7ce6c1ee-551a-4fab-938e-c3d7f81689db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 1.087559 Aug 18 17:05:55.072286 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 37/72] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:53 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:55.152354 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:55.152990 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:55.161355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:55.162649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:55.162649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:55.162965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:55.163419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:55.171311 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:55.242105 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=6 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:55.642455 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=34 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:55.716612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:55.733080 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:55.746362 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:55.753522 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ad9c399c-3e65-43be-8c49-37291166a199 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.615020 Aug 18 17:05:55.764215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 38/73] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:55 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:05:55.783025 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:55.809894 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ed10225d-9b0d-4e50-90d4-14f8e2074c2f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.984484 Aug 18 17:05:55.813339 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 36/74] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:54 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:55.841495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:55.843308 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:55.870062 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:55.870546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:55.870979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:55.874193 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:55.875963 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:55.876503 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:56.080833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:56.080833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:56.086602 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:56.090022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:56.092866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:56.093829 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:56.094462 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:56.096866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:56.685033 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:56.695343 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-685db259-896f-48a9-9232-489edac6a662 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.858145 Aug 18 17:05:56.699350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 39/75] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:55 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:56.784474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=22 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:56.869691 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-9317e1da-262b-4a33-9e87-939ca70b575a req-d8375970-2b84-48b5-8b85-c51e3c804490 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e481aa-bf5a-436b-baca-f5c8b88de401", "tag": "9d480631-4b24-43e0-8000-c7d4668399bb"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:56.884388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9317e1da-262b-4a33-9e87-939ca70b575a req-d8375970-2b84-48b5-8b85-c51e3c804490 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:56.885015 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9317e1da-262b-4a33-9e87-939ca70b575a req-d8375970-2b84-48b5-8b85-c51e3c804490 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:56.885523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9317e1da-262b-4a33-9e87-939ca70b575a req-d8375970-2b84-48b5-8b85-c51e3c804490 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:56.939640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-9317e1da-262b-4a33-9e87-939ca70b575a req-d8375970-2b84-48b5-8b85-c51e3c804490 service nova] Creating event network-changed:9d480631-4b24-43e0-8000-c7d4668399bb for instance 68e481aa-bf5a-436b-baca-f5c8b88de401 on hv-cinder-85367 Aug 18 17:05:56.940798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9317e1da-262b-4a33-9e87-939ca70b575a req-d8375970-2b84-48b5-8b85-c51e3c804490 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 17:05:56.941451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9317e1da-262b-4a33-9e87-939ca70b575a req-d8375970-2b84-48b5-8b85-c51e3c804490 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 17:05:56.947655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8681af73-c9fb-4b52-b3d6-249239886e4d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:56.948881 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8681af73-c9fb-4b52-b3d6-249239886e4d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:56.954280 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8681af73-c9fb-4b52-b3d6-249239886e4d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:56.957024 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8681af73-c9fb-4b52-b3d6-249239886e4d None None] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:56.957489 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8681af73-c9fb-4b52-b3d6-249239886e4d None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:56.958074 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8681af73-c9fb-4b52-b3d6-249239886e4d None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:56.970203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.compute.rpcapi [None req-8681af73-c9fb-4b52-b3d6-249239886e4d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 17:05:56.971153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8681af73-c9fb-4b52-b3d6-249239886e4d None None] Releasing lock "compute-rpcapi-router" {{(pid=121267) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 17:05:57.018450 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8681af73-c9fb-4b52-b3d6-249239886e4d None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.245335 Aug 18 17:05:57.019212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 40/76] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:05:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:05:57.027699 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:57.030634 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:57.040905 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:57.041697 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:57.042758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:57.045275 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:57.046256 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:57.046846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:57.067749 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:57.073847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-dc2f7554-ca58-4d84-a9b8-55cd1af365c7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.999197 Aug 18 17:05:57.079262 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 37/77] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:56 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:05:57.089661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:57.091535 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:57.107293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:57.107985 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:57.108437 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:57.109171 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:57.109632 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:57.111134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:57.387205 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:57.402274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:57.403823 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:57.412677 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ada59749-30d0-4c85-84aa-38164213b143 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.391587 Aug 18 17:05:57.413279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 41/78] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:57 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:05:57.721824 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:57.722605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:57.736091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:57.736091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:57.736091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:57.736486 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:57.737399 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:57.738142 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:57.967446 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:57.982127 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-dcabe622-69fc-401a-8ccc-c254b9145db2 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.901656 Aug 18 17:05:57.986190 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 38/79] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:57 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:58.005037 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:58.016363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5c5c0700-e49d-4515-b135-c1b75825cbf1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.300149 Aug 18 17:05:58.016965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 42/80] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:57 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:58.096959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:58.097760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:58.109356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:58.110601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:58.111191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:58.112207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:58.113017 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:58.113927 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:58.145773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:58.170737 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-ab3b8995-1be8-46fc-99ed-5b052b320421 req-2fb3de16-6276-4250-b54d-35c88e1bae4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "939d201c-6bc3-470f-9488-acd5f3ed99fd", "tag": "13093e80-0e16-4f83-85a6-e6aed9ea2652"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:58.196892 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ab3b8995-1be8-46fc-99ed-5b052b320421 req-2fb3de16-6276-4250-b54d-35c88e1bae4a service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:58.199026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ab3b8995-1be8-46fc-99ed-5b052b320421 req-2fb3de16-6276-4250-b54d-35c88e1bae4a service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:58.200755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ab3b8995-1be8-46fc-99ed-5b052b320421 req-2fb3de16-6276-4250-b54d-35c88e1bae4a service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:58.260814 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-ab3b8995-1be8-46fc-99ed-5b052b320421 req-2fb3de16-6276-4250-b54d-35c88e1bae4a service nova] Creating event network-changed:13093e80-0e16-4f83-85a6-e6aed9ea2652 for instance 939d201c-6bc3-470f-9488-acd5f3ed99fd on hv-cinder-85367 Aug 18 17:05:58.261354 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ab3b8995-1be8-46fc-99ed-5b052b320421 req-2fb3de16-6276-4250-b54d-35c88e1bae4a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121268) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 18 17:05:58.261736 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ab3b8995-1be8-46fc-99ed-5b052b320421 req-2fb3de16-6276-4250-b54d-35c88e1bae4a service nova] Acquired lock "compute-rpcapi-router" {{(pid=121268) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 18 17:05:58.269755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9af3fb48-7906-4126-b912-4984ae6bb774 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:58.270445 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9af3fb48-7906-4126-b912-4984ae6bb774 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:58.270886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9af3fb48-7906-4126-b912-4984ae6bb774 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:58.271705 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9af3fb48-7906-4126-b912-4984ae6bb774 None None] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:58.272168 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9af3fb48-7906-4126-b912-4984ae6bb774 None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:58.272597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9af3fb48-7906-4126-b912-4984ae6bb774 None None] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:58.288595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=100 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:05:58.292220 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.compute.rpcapi [None req-9af3fb48-7906-4126-b912-4984ae6bb774 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 18 17:05:58.293620 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9af3fb48-7906-4126-b912-4984ae6bb774 None None] Releasing lock "compute-rpcapi-router" {{(pid=121268) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 18 17:05:58.315194 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9af3fb48-7906-4126-b912-4984ae6bb774 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.327200 Aug 18 17:05:58.317157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 39/81] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:05:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:58.329641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:58.344903 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-aaa8bfd6-aa83-49b0-aad4-9fd77c939170 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.254639 Aug 18 17:05:58.358161 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 43/82] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:58 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:58.443192 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:58.443959 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:58.452884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:58.453387 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:58.454533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:58.454636 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:58.455185 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:58.455803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:58.602689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:58.611897 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:58.613735 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:58.615191 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2c2b3717-8775-45c7-81ce-447a37cfa67b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.177515 Aug 18 17:05:58.616121 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 40/83] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:58 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:05:59.004546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:59.005516 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:59.019886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:59.020726 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:59.021233 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:59.022017 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:59.022617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:59.025938 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:59.037774 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:59.038473 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:59.046046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:59.046803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:59.047741 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:59.048504 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:59.049163 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:59.049788 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:59.258206 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:59.266941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-14a9eace-1a35-4e17-9fc4-4e1d54faeb7a tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.266676 Aug 18 17:05:59.267842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 44/84] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:58 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:59.273239 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-d523a610-c5fe-4d80-8c56-b52e4b831ddd req-4f150941-2921-4947-838d-391920d59937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61f40fc8-4d8a-4aac-b8f5-84ec963fabd7", "tag": "a85a9ff0-70eb-48e8-a79f-7454c12baa1a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:05:59.285122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-d523a610-c5fe-4d80-8c56-b52e4b831ddd req-4f150941-2921-4947-838d-391920d59937 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:59.285901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-d523a610-c5fe-4d80-8c56-b52e4b831ddd req-4f150941-2921-4947-838d-391920d59937 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:59.286502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-d523a610-c5fe-4d80-8c56-b52e4b831ddd req-4f150941-2921-4947-838d-391920d59937 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:59.299584 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:59.299792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-d523a610-c5fe-4d80-8c56-b52e4b831ddd req-4f150941-2921-4947-838d-391920d59937 service nova] Creating event network-changed:a85a9ff0-70eb-48e8-a79f-7454c12baa1a for instance 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 on hv-cinder-85367 Aug 18 17:05:59.305151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-d523a610-c5fe-4d80-8c56-b52e4b831ddd req-4f150941-2921-4947-838d-391920d59937 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035993 Aug 18 17:05:59.305757 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 45/85] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:05:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:05:59.316472 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2760fea9-7024-47a2-bc7c-9e2430a1f080 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.281162 Aug 18 17:05:59.317816 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 41/86] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:59 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:05:59.367853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:59.368906 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:59.382062 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:59.382873 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:59.384066 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:59.384973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:59.385511 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:59.385953 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:59.633484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:59.644599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-98405147-27de-40c3-a38a-c9a580d544d4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.281770 Aug 18 17:05:59.644815 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:05:59.651696 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:05:59.652050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 46/87] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:05:59 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:05:59.652931 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:59.653561 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:59.653926 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:59.655222 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:05:59.655793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:05:59.656595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:05:59.889681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:59.911242 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:59.913483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:05:59.915072 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c3667a52-659d-4d35-9217-ed1ef4924a2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.281045 Aug 18 17:05:59.936304 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 42/88] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:05:59 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:06:00.290928 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:00.291816 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:00.298732 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:00.299567 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:00.300218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:00.301194 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:00.302005 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:00.302634 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:00.339514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:00.341589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:00.353232 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:00.356224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:00.356726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:00.358947 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:00.359728 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:00.361868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:00.363216 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:00.518655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:00.530125 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9f3a6852-0a20-41bc-86c4-07ad7e70fcc1 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.243501 Aug 18 17:06:00.543800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 47/89] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:00 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:00.543800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-5a309761-256f-447c-a49f-9ac6f5acd166 req-94afadfa-06b6-4ec9-9ff7-41e3dda9e1b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "986651bb-c047-4346-9e7c-0f3e49a9cc8a", "tag": "26906fcd-6e6c-4363-8218-2219658555d1"}, {"name": "network-changed", "server_uuid": "e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989", "tag": "ed89df0f-8d34-4c21-9aa8-bc66ad76bcbf"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:00.555181 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5a309761-256f-447c-a49f-9ac6f5acd166 req-94afadfa-06b6-4ec9-9ff7-41e3dda9e1b9 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:00.555700 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5a309761-256f-447c-a49f-9ac6f5acd166 req-94afadfa-06b6-4ec9-9ff7-41e3dda9e1b9 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:00.556132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5a309761-256f-447c-a49f-9ac6f5acd166 req-94afadfa-06b6-4ec9-9ff7-41e3dda9e1b9 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:00.570577 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-5a309761-256f-447c-a49f-9ac6f5acd166 req-94afadfa-06b6-4ec9-9ff7-41e3dda9e1b9 service nova] Creating event network-changed:26906fcd-6e6c-4363-8218-2219658555d1 for instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a on hv-cinder-85367 Aug 18 17:06:00.571548 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-5a309761-256f-447c-a49f-9ac6f5acd166 req-94afadfa-06b6-4ec9-9ff7-41e3dda9e1b9 service nova] Creating event network-changed:ed89df0f-8d34-4c21-9aa8-bc66ad76bcbf for instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 on hv-cinder-85367 Aug 18 17:06:00.578909 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-5a309761-256f-447c-a49f-9ac6f5acd166 req-94afadfa-06b6-4ec9-9ff7-41e3dda9e1b9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.044107 Aug 18 17:06:00.580866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 48/90] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:06:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:00.597370 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:00.609861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5d0d95f3-59de-4250-af28-38aedd8b080d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.275381 Aug 18 17:06:00.616469 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 43/91] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:00 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:00.674179 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:00.675048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:00.683956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:00.684544 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:00.685239 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:00.686108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:00.686650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:00.687383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:00.872337 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:00.883287 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-765365dc-ba35-4548-967c-70b0a3e795ec tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.216383 Aug 18 17:06:00.883916 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 49/92] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:00 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:00.943271 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:00.944245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:00.952803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:00.953466 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:00.953954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:00.954900 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:00.955531 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:00.956241 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:01.117822 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:01.130478 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:01.132035 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:01.133157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0c648438-f503-4489-a9ce-b742a3da4a23 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.194488 Aug 18 17:06:01.134224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 44/93] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:00 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:01.551338 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:01.551917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:01.558310 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:01.558809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:01.559546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:01.560313 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:01.561030 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:01.561678 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:01.630918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:01.631575 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:01.638540 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:01.639023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:01.639663 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:01.640579 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:01.641338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:01.641917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:01.783686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:01.792747 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-162581f0-007a-4fbc-b263-85bac1426067 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.245488 Aug 18 17:06:01.793433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 50/94] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:01 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:01.841936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:01.852884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1f3331de-181d-44de-bb4c-9f470f058389 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.226512 Aug 18 17:06:01.853593 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 45/95] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:01 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:01.912241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:01.912241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:01.912827 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:01.920153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:01.920153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:01.920937 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:01.921587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:01.922025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:02.117766 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:02.127221 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-67f2b966-1189-4200-abaa-9192e509d23b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.226255 Aug 18 17:06:02.140279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 51/96] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:01 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:02.159244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:02.160108 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:02.172451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:02.172451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:02.172451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:02.172451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:02.172756 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:02.172756 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:02.394994 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:02.408199 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:02.412748 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:02.412748 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1eecb4fa-781b-4007-b0b5-bb2600f64257 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.256941 Aug 18 17:06:02.412748 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 46/97] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:02 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:02.814901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:02.816276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:02.824751 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:02.826080 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:02.826958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:02.827928 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:02.828862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:02.829568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:02.874568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:02.875203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:02.889523 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:02.892944 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:02.893979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:02.895007 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:02.898558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:02.899178 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:02.997635 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:03.144221 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-42b43f58-103b-43ea-9ebf-34efd77e7fbe tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.198687 Aug 18 17:06:03.144221 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 52/98] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:02 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:03.145201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:03.145201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-57106f1a-a3e7-40fa-9e68-186c0b837cb5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.235186 Aug 18 17:06:03.145201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 47/99] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:02 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:03.152332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:03.152970 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:03.158800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:03.159282 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:03.159756 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:03.160460 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:03.160911 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:03.161334 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:03.373003 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:03.381350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bbb29f24-5bf5-44d1-8803-ef7462d5090b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.233237 Aug 18 17:06:03.381940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 53/100] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:03 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:03.435638 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:03.435638 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:03.444229 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:03.444731 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:03.445177 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:03.446192 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:03.446822 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:03.447273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:03.665803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:03.675896 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:03.677505 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:03.678865 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d6221d4f-6be5-434a-a9b8-8a6a740a82ee tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.249091 Aug 18 17:06:03.679778 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 48/101] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:03 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:04.155176 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:04.155994 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:04.156332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:04.157027 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:04.163174 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:04.164144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:04.164559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:04.165122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:04.165500 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:04.165960 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:04.166459 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:04.167166 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:04.167390 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:04.167782 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:04.168330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:04.168929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:04.531392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:04.563778 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-83a6099d-cdd4-439b-9339-e14ddb95fe3c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.413754 Aug 18 17:06:04.566015 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 54/102] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:04 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:04.585124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:04.586310 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:04.606553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:04.607263 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:04.607815 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:04.610959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:04.611607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:04.612117 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:04.840184 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:04.853034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d9729fb5-98ce-406a-8644-be7a457a856b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.705121 Aug 18 17:06:04.855149 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 49/103] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:04 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:04.872702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:04.872702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:04.876695 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:04.877690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:04.878290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:04.879557 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:04.880312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:04.880967 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:04.923197 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:04.931176 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bb4dc050-ef7c-48b7-b2a9-e31c87d64c1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.361928 Aug 18 17:06:04.931979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 55/104] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:04 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:05.047285 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:05.055789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:05.057335 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:05.058461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1fb4e76a-9c7c-4988-b540-296691d800dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.202039 Aug 18 17:06:05.059015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 50/105] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:04 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:05.587261 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:05.589862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:05.596337 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:05.596912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:05.597418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:05.598194 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:05.598835 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:05.599453 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:05.829652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:05.837633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-db367b98-9bd4-42aa-b359-35c24afb947e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.255273 Aug 18 17:06:05.851326 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 56/106] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:05 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:05.874899 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:05.875490 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:05.881559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:05.885918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:05.886678 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:05.890408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:05.890408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:05.896781 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:05.953644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:05.953644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:05.959714 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:05.960495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:05.961117 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:05.961993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:05.962604 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:05.963194 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:06.121476 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:06.132347 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7b4ec602-be87-4e3a-89c7-8cb126055978 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.261246 Aug 18 17:06:06.133276 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 51/107] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:05 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:06.138248 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:06.139040 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:06.145627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:06.146309 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:06.146898 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:06.147845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:06.150066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:06.150501 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:06.155928 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:06.165415 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bac1523d-4a60-47ee-a434-41050d9aa425 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.217300 Aug 18 17:06:06.166493 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 57/108] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:05 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:06.332791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:06.342091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:06.343815 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:06.344992 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f1179c65-245a-403c-a9fe-f183a10f82ff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.210536 Aug 18 17:06:06.345568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 52/109] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:06 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:06.870134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:06.870812 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:06.877379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:06.877906 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:06.878406 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:06.879164 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:06.879714 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:06.880184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:06.968282 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:07.034127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:07.041891 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2c83462e-91f2-4c09-8469-c716be337691 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.176313 Aug 18 17:06:07.043571 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 58/110] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:06 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:07.155351 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:07.156625 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:07.162864 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:07.163355 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:07.163855 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:07.164557 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:07.165188 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:07.165620 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:07.185832 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:07.186571 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:07.192953 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:07.193585 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:07.194138 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:07.194929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:07.195507 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:07.196107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:07.332504 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:07.342237 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8464edff-9ec0-4bb4-b23f-f64560d969d4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.192747 Aug 18 17:06:07.343840 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 53/111] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:07 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:07.368131 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:07.369258 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:07.381083 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:07.381643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:07.382090 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:07.382809 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:07.389669 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:07.390381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:07.484655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:07.513000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5ce5c3cc-9fdd-453e-bacd-009741e58420 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.330998 Aug 18 17:06:07.522212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 59/112] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:07 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:07.590958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:07.599612 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:07.601212 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:07.602383 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9dba74b7-1e46-453b-ae65-68d0de648148 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.238491 Aug 18 17:06:07.602938 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 54/113] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:07 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:06:08.062090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:08.062705 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:08.068999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:08.069479 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:08.069911 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:08.070590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:08.071042 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:08.071479 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:08.363584 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:08.364178 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:08.367288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:08.370959 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:08.383891 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:08.384640 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:08.385585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:08.386181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:08.386798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:08.525050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:08.533446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-81aefc8f-5e82-4203-aa70-63fd51b069b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.475156 Aug 18 17:06:08.534031 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 60/114] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:08 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:08.543408 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:08.544039 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:08.562733 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:08.563686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:08.564283 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:08.565028 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:08.566132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:08.566576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:08.573308 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:08.916798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:08.933880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6f22be82-13dd-49a3-af50-a4cde6f6efe5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.394205 Aug 18 17:06:08.935784 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 61/115] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:08 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:08.942069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:08.949025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:08.957172 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:08.958021 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:08.958720 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:08.959810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:08.961285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:08.961954 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:09.083616 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:09.096497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7b1feaf6-79d7-4c73-9cf9-732f8f338a0b tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.735622 Aug 18 17:06:09.097629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 55/116] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:08 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:09.261453 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:09.274363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:09.276658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:09.278240 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b85c67de-26ff-4b87-94af-fb21afc9d846 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.341149 Aug 18 17:06:09.279250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 62/117] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:08 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:09.555303 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:09.556000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:09.563353 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:09.563867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:09.564352 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:09.565580 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:09.566240 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:09.566882 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:09.585844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=100 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:09.858801 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:09.867297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-92ba1b7b-2f60-42b0-9915-9edbfb37444a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.316837 Aug 18 17:06:09.869547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 56/118] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:09 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:09.954902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:09.955593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:09.961445 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:09.962000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:09.962432 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:09.963123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:09.963611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:09.964035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:10.105586 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:10.117933 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:10.118552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:10.127770 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0c279a84-afcd-4535-b09f-118380d1ffc4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.176565 Aug 18 17:06:10.128638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 63/119] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:09 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:10.139630 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:10.139630 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:10.139630 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:10.139630 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:10.139988 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:10.139988 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:10.297998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:10.307148 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:10.307729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d2b91064-a8c1-452c-b6d0-82d39903b16e tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.193735 Aug 18 17:06:10.307814 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 57/120] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:10 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:10.307883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:10.316068 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:10.316563 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:10.320796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:10.320796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:10.320796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:10.320796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:10.497893 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:10.509032 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:10.510875 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:10.512472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-139510e5-b4f3-4323-86fd-890f99f6b475 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.210194 Aug 18 17:06:10.529592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 64/121] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:10 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:10.895223 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:10.896078 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:10.911847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:10.912480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:10.913241 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:10.914050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:10.914740 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:10.915348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:11.076956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:11.085356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ef76f5df-c546-4e6c-863c-d03d50b9e1fd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.195342 Aug 18 17:06:11.086526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 58/122] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:10 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:11.158893 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:11.159477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:11.175143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:11.178287 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-641dd8a4-7ffa-4956-9b3a-8f4222065686 req-3fd01cfe-8987-4b24-967a-5e22e49cb2c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986651bb-c047-4346-9e7c-0f3e49a9cc8a", "name": "network-vif-plugged", "status": "completed", "tag": "26906fcd-6e6c-4363-8218-2219658555d1"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:11.184409 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:11.185862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:11.186805 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:11.187470 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:11.188144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:11.202935 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-641dd8a4-7ffa-4956-9b3a-8f4222065686 req-3fd01cfe-8987-4b24-967a-5e22e49cb2c1 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:11.203774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-641dd8a4-7ffa-4956-9b3a-8f4222065686 req-3fd01cfe-8987-4b24-967a-5e22e49cb2c1 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:11.204412 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-641dd8a4-7ffa-4956-9b3a-8f4222065686 req-3fd01cfe-8987-4b24-967a-5e22e49cb2c1 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:11.227880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-641dd8a4-7ffa-4956-9b3a-8f4222065686 req-3fd01cfe-8987-4b24-967a-5e22e49cb2c1 service nova] Creating event network-vif-plugged:26906fcd-6e6c-4363-8218-2219658555d1 for instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a on hv-cinder-85367 Aug 18 17:06:11.235007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-641dd8a4-7ffa-4956-9b3a-8f4222065686 req-3fd01cfe-8987-4b24-967a-5e22e49cb2c1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.255660 Aug 18 17:06:11.236584 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 65/123] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:06:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:06:11.331931 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:11.337506 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:11.357569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:11.358294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:11.359248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:11.360597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:11.367293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:11.367293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:11.446686 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:11.457140 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fce50b82-2741-4ffa-9b4d-4aaf0385c187 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.305408 Aug 18 17:06:11.457723 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 59/124] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:11 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:11.536948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:11.538115 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:11.546046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:11.547003 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:11.548077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:11.551166 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:11.551166 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:11.551166 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:11.590634 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:11.599087 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9b583a1b-eac9-45ce-a477-47fa2fd48a78 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.274222 Aug 18 17:06:11.602278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 66/125] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:11 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:11.822729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:11.839207 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:11.841519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:11.843504 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-38e67dc5-2c14-476f-8d3e-e08e928f9be5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.311895 Aug 18 17:06:11.844608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 60/126] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:11 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:06:12.108074 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:12.108692 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:12.114692 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:12.115181 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:12.115949 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:12.116647 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:12.117097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:12.117592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:12.308486 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:12.319718 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1053e9b3-a7ce-411f-b1c4-ebacd55ce692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.215913 Aug 18 17:06:12.333643 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 67/127] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:12 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:12.479958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:12.481240 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:12.487856 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:12.488718 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:12.489475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:12.490387 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:12.490997 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:12.491727 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:12.631624 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:12.632587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:12.652722 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:12.657215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:12.658621 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:12.661060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:12.664109 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:12.669495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:12.775340 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:12.790139 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-725c31eb-feca-4266-ad02-b6786a5f44c2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.314999 Aug 18 17:06:12.791080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 61/128] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:12 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:12.870329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:12.870954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:12.877446 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:12.878174 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:12.878760 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:12.879696 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:12.880486 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:12.881071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:12.954843 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:12.964332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f196508f-01d9-4a50-8d8b-86dca00bb0cc tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.342749 Aug 18 17:06:12.975456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 68/129] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:12 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:13.080538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:13.089721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:13.092006 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:13.095081 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-14b5742c-cbcb-4847-b955-0acc0cf045d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.227114 Aug 18 17:06:13.095081 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 62/130] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:12 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:13.252097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-3b36da7b-4b9a-45c4-abef-00a8697c7dfe req-0cb260b2-8a4d-493b-ae13-2d1577660b86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989", "name": "network-vif-plugged", "status": "completed", "tag": "ed89df0f-8d34-4c21-9aa8-bc66ad76bcbf"}, {"server_uuid": "61f40fc8-4d8a-4aac-b8f5-84ec963fabd7", "name": "network-vif-plugged", "status": "completed", "tag": "a85a9ff0-70eb-48e8-a79f-7454c12baa1a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:13.263748 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-3b36da7b-4b9a-45c4-abef-00a8697c7dfe req-0cb260b2-8a4d-493b-ae13-2d1577660b86 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:13.264133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-3b36da7b-4b9a-45c4-abef-00a8697c7dfe req-0cb260b2-8a4d-493b-ae13-2d1577660b86 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:13.264554 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-3b36da7b-4b9a-45c4-abef-00a8697c7dfe req-0cb260b2-8a4d-493b-ae13-2d1577660b86 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:13.277975 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-3b36da7b-4b9a-45c4-abef-00a8697c7dfe req-0cb260b2-8a4d-493b-ae13-2d1577660b86 service nova] Creating event network-vif-plugged:ed89df0f-8d34-4c21-9aa8-bc66ad76bcbf for instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 on hv-cinder-85367 Aug 18 17:06:13.278502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-3b36da7b-4b9a-45c4-abef-00a8697c7dfe req-0cb260b2-8a4d-493b-ae13-2d1577660b86 service nova] Creating event network-vif-plugged:a85a9ff0-70eb-48e8-a79f-7454c12baa1a for instance 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 on hv-cinder-85367 Aug 18 17:06:13.284908 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-3b36da7b-4b9a-45c4-abef-00a8697c7dfe req-0cb260b2-8a4d-493b-ae13-2d1577660b86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037214 Aug 18 17:06:13.285517 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 69/131] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:06:13 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:13.341224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:13.341833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:13.359980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:13.360977 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:13.361552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:13.365132 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:13.365904 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:13.366815 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:13.588809 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:13.598064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-866c1451-50ef-4b06-b67a-376981cc71d4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.260626 Aug 18 17:06:13.608061 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 63/132] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:13 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:13.812484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:13.813043 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:13.820566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:13.821048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:13.821667 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:13.822332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:13.822782 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:13.823196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:13.987280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:13.989809 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:13.990166 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:13.997173 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-871640eb-b01b-4011-b09a-5a85ad28c15b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.189032 Aug 18 17:06:13.997647 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:13.997762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 70/133] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:13 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:13.998634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:13.999277 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:14.000216 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:14.000840 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:14.001420 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:14.117588 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:14.118271 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:14.128377 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:14.128849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:14.129285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:14.130660 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:14.137668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:14.137668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:14.375313 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:14.379116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:14.390368 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2ebf7697-62f3-4e50-b952-c8c32b21d86f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1315 microversion: 2.1 time: 0.407483 Aug 18 17:06:14.392364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:14.394020 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:14.395777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6e08e578-1188-4a31-93c2-7827bb43e30e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.283299 Aug 18 17:06:14.398935 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 71/134] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:14 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:14.407531 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 64/135] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:13 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1315 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:14.618546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:14.619213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:14.626364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:14.626859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:14.627295 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:14.628028 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:14.628485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:14.628971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:14.817058 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:14.825477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-124b2da3-84c8-4299-a9d9-fab1af3a1a11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1366 microversion: 2.1 time: 0.211086 Aug 18 17:06:14.826177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 72/136] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:14 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:15.018251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:15.018980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:15.025674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:15.026440 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:15.027070 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:15.027810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:15.028266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:15.029348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:15.248754 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:15.257079 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9d27528d-2e20-436e-9a9c-728bf92e7864 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.243624 Aug 18 17:06:15.257880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 65/137] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:15 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:15.299620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-a7b2df1b-2553-4a6c-91a3-f15d23feb01d req-ca854619-74a8-431f-805e-cfd73d02972d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e481aa-bf5a-436b-baca-f5c8b88de401", "name": "network-vif-plugged", "status": "completed", "tag": "9d480631-4b24-43e0-8000-c7d4668399bb"}, {"server_uuid": "939d201c-6bc3-470f-9488-acd5f3ed99fd", "name": "network-vif-plugged", "status": "completed", "tag": "13093e80-0e16-4f83-85a6-e6aed9ea2652"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:15.310475 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-a7b2df1b-2553-4a6c-91a3-f15d23feb01d req-ca854619-74a8-431f-805e-cfd73d02972d service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:15.310950 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-a7b2df1b-2553-4a6c-91a3-f15d23feb01d req-ca854619-74a8-431f-805e-cfd73d02972d service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:15.311376 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-a7b2df1b-2553-4a6c-91a3-f15d23feb01d req-ca854619-74a8-431f-805e-cfd73d02972d service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:15.324144 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-a7b2df1b-2553-4a6c-91a3-f15d23feb01d req-ca854619-74a8-431f-805e-cfd73d02972d service nova] Creating event network-vif-plugged:9d480631-4b24-43e0-8000-c7d4668399bb for instance 68e481aa-bf5a-436b-baca-f5c8b88de401 on hv-cinder-85367 Aug 18 17:06:15.324646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-a7b2df1b-2553-4a6c-91a3-f15d23feb01d req-ca854619-74a8-431f-805e-cfd73d02972d service nova] Creating event network-vif-plugged:13093e80-0e16-4f83-85a6-e6aed9ea2652 for instance 939d201c-6bc3-470f-9488-acd5f3ed99fd on hv-cinder-85367 Aug 18 17:06:15.330823 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-a7b2df1b-2553-4a6c-91a3-f15d23feb01d req-ca854619-74a8-431f-805e-cfd73d02972d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034968 Aug 18 17:06:15.331493 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 73/138] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:06:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:15.411881 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:15.412694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:15.420457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:15.421163 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:15.422516 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:15.423583 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:15.424439 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:15.425028 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:15.434482 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:15.439924 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:15.454115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:15.454598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:15.455037 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:15.455909 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:15.456369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:15.456788 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:15.673316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:15.685562 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:15.685562 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:15.686769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b4ab4565-6f91-40ab-8667-6fe36d3aad90 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.264223 Aug 18 17:06:15.696773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 74/139] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:15 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:15.754500 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:15.762413 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-15578149-d7d2-47cd-ab08-d2974c67e6ed tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1503 microversion: 2.1 time: 0.354337 Aug 18 17:06:15.763990 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 66/140] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:15 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1503 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:15.859732 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:15.859732 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:15.867668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:15.871275 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:15.872637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:15.873607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:15.875092 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:15.875783 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:16.075935 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:16.085786 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-caa78224-17e8-46aa-a203-f98e0e9e709b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1557 microversion: 2.1 time: 0.242820 Aug 18 17:06:16.086375 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 75/141] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:15 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1557 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:16.107570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-601cc89b-42ba-43de-ae5e-247f0057e9ea tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:16.108185 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-601cc89b-42ba-43de-ae5e-247f0057e9ea tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:16.114253 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-601cc89b-42ba-43de-ae5e-247f0057e9ea tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:16.114736 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-601cc89b-42ba-43de-ae5e-247f0057e9ea tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:16.115168 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-601cc89b-42ba-43de-ae5e-247f0057e9ea tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:16.164487 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-601cc89b-42ba-43de-ae5e-247f0057e9ea tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:16.164487 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-601cc89b-42ba-43de-ae5e-247f0057e9ea tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:16.164487 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-601cc89b-42ba-43de-ae5e-247f0057e9ea tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:16.264641 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-601cc89b-42ba-43de-ae5e-247f0057e9ea tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161163 Aug 18 17:06:16.265971 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 67/142] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Aug 18 17:06:16 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:16.278563 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:16.279471 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:16.287408 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:16.288406 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:16.289066 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:16.290132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:16.291082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:16.292007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:16.701628 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:16.712355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-12078e67-ecfb-4e58-8d4d-e4628b17a07d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1321 microversion: 2.1 time: 0.437525 Aug 18 17:06:16.718154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 76/143] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:16 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:16.728537 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:16.730095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:16.740808 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:16.741299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:16.742040 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:16.743462 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:16.743462 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:16.744034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:17.095645 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:17.114044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:17.119948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:17.124786 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c9435e6e-bff4-490c-aea1-cdeb84edced1 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.413649 Aug 18 17:06:17.126875 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 68/144] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:16 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:06:17.738031 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:17.738744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:17.744882 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:17.745609 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:17.745865 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:17.746712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:17.747163 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:17.747613 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:17.961878 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8d559f26-78e9-40a2-8a7f-a216bd956e6f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "52b6cdf3-2d5b-485a-8cfc-d477796c1208"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:17.961878 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8d559f26-78e9-40a2-8a7f-a216bd956e6f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:17.975746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:17.978100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8d559f26-78e9-40a2-8a7f-a216bd956e6f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:17.978674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8d559f26-78e9-40a2-8a7f-a216bd956e6f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:17.979123 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8d559f26-78e9-40a2-8a7f-a216bd956e6f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:17.979888 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8d559f26-78e9-40a2-8a7f-a216bd956e6f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:17.980348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8d559f26-78e9-40a2-8a7f-a216bd956e6f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:17.980771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8d559f26-78e9-40a2-8a7f-a216bd956e6f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:17.986941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b45f13e7-4110-4b49-8a08-791fe5862148 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1516 microversion: 2.1 time: 0.252765 Aug 18 17:06:17.987568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 77/145] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:17 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1516 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:18.018047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:18.026245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:18.037842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:18.038349 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:18.038793 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:18.039534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:18.040001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:18.040429 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:18.123306 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lazy-loading 'flavor' on Instance uuid 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:06:18.308024 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:18.557305 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0bc23464-4020-4c7f-9e0f-33823dbf4143 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7/action" status: 200 len: 32 microversion: 2.1 time: 0.547475 Aug 18 17:06:18.564191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 78/146] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:06:18 2022] POST /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7/action => generated 32 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 17:06:18.570950 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:18.571895 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:18.583610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:18.591363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:18.591363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:18.591363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:18.591363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:18.591863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:18.800372 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:18.814433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:18.814433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:18.814433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3f177cb3-b893-4cea-bfda-5024f346486c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1406 microversion: 2.20 time: 0.246203 Aug 18 17:06:18.814956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 79/147] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:18 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1406 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:18.818543 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-9fa6ab6a-c6d1-4520-93cc-e24ef9021d62 req-d48f339e-47a3-4e24-a11d-f4af64978aa8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989", "tag": "ed89df0f-8d34-4c21-9aa8-bc66ad76bcbf"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:18.829642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9fa6ab6a-c6d1-4520-93cc-e24ef9021d62 req-d48f339e-47a3-4e24-a11d-f4af64978aa8 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:18.830139 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9fa6ab6a-c6d1-4520-93cc-e24ef9021d62 req-d48f339e-47a3-4e24-a11d-f4af64978aa8 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:18.830571 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9fa6ab6a-c6d1-4520-93cc-e24ef9021d62 req-d48f339e-47a3-4e24-a11d-f4af64978aa8 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:18.842958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-9fa6ab6a-c6d1-4520-93cc-e24ef9021d62 req-d48f339e-47a3-4e24-a11d-f4af64978aa8 service nova] Creating event network-changed:ed89df0f-8d34-4c21-9aa8-bc66ad76bcbf for instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 on hv-cinder-85367 Aug 18 17:06:18.851000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-9fa6ab6a-c6d1-4520-93cc-e24ef9021d62 req-d48f339e-47a3-4e24-a11d-f4af64978aa8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036645 Aug 18 17:06:18.851710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 80/148] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:06:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:18.857490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:18.858191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:18.865406 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:18.865959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:18.866392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:18.867271 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:18.868034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:18.868627 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:19.132694 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:19.150288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f3562026-b962-4022-be05-2559bcc9d71f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.297197 Aug 18 17:06:19.161973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 81/149] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:18 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:19.846321 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:19.847395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:19.850640 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8d559f26-78e9-40a2-8a7f-a216bd956e6f tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "POST /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.895920 Aug 18 17:06:19.851276 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 69/150] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:06:17 2022] POST /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a/os-volume_attachments => generated 194 bytes in 1897 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:19.886576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:19.888451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:19.889049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:19.890610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:19.891806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:19.893608 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:20.171798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:20.180116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:20.188573 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:20.188573 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1e9d1d29-74ed-416a-85dc-c0a2c07f4af8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1599 microversion: 2.20 time: 0.349960 Aug 18 17:06:20.188573 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 82/151] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:06:19 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1599 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:06:20.189065 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:20.189065 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:20.192421 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:20.192907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:20.193341 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:20.194231 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:20.194866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:20.195297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:20.206943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c5c2f837-d258-4b1f-8cff-1f2f7c1e6fd6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:20.207561 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c5c2f837-d258-4b1f-8cff-1f2f7c1e6fd6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:20.221207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5c2f837-d258-4b1f-8cff-1f2f7c1e6fd6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:20.222014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5c2f837-d258-4b1f-8cff-1f2f7c1e6fd6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:20.222591 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5c2f837-d258-4b1f-8cff-1f2f7c1e6fd6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:20.224583 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5c2f837-d258-4b1f-8cff-1f2f7c1e6fd6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:20.224583 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5c2f837-d258-4b1f-8cff-1f2f7c1e6fd6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:20.224583 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5c2f837-d258-4b1f-8cff-1f2f7c1e6fd6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:20.385575 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c5c2f837-d258-4b1f-8cff-1f2f7c1e6fd6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.182673 Aug 18 17:06:20.388051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 83/152] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Aug 18 17:06:20 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-interface => generated 285 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 17:06:20.800767 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:20.824228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ed8ce1a5-4d6f-4e61-8ab2-71eb85404d5d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.638875 Aug 18 17:06:20.828499 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 70/153] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:20 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:21.848555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:21.849437 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:21.855310 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:21.861000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:21.861817 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:21.862497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:21.863487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:21.864016 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:21.868664 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:22.295774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:22.307245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d0dfae96-c49b-40e3-9108-af19d6f8e802 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.462654 Aug 18 17:06:22.308010 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 84/154] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:21 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:22.648466 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-b0563bbf-da34-470a-9498-647f7f0a5217 req-619adc92-5cb5-4d05-81bc-c6d64d7ad502 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "68e481aa-bf5a-436b-baca-f5c8b88de401", "tag": "9d480631-4b24-43e0-8000-c7d4668399bb"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:22.660899 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b0563bbf-da34-470a-9498-647f7f0a5217 req-619adc92-5cb5-4d05-81bc-c6d64d7ad502 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:22.661519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b0563bbf-da34-470a-9498-647f7f0a5217 req-619adc92-5cb5-4d05-81bc-c6d64d7ad502 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:22.662039 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b0563bbf-da34-470a-9498-647f7f0a5217 req-619adc92-5cb5-4d05-81bc-c6d64d7ad502 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:22.674300 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-b0563bbf-da34-470a-9498-647f7f0a5217 req-619adc92-5cb5-4d05-81bc-c6d64d7ad502 service nova] Creating event network-changed:9d480631-4b24-43e0-8000-c7d4668399bb for instance 68e481aa-bf5a-436b-baca-f5c8b88de401 on hv-cinder-85367 Aug 18 17:06:22.680025 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-b0563bbf-da34-470a-9498-647f7f0a5217 req-619adc92-5cb5-4d05-81bc-c6d64d7ad502 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035047 Aug 18 17:06:22.689185 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 71/155] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:23.332046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:23.334077 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:23.342136 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:23.342847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:23.344063 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:23.345211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:23.345847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:23.346610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:23.544118 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:23.564844 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-16404f46-a779-4cf0-9aff-dcaaadc46127 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.230096 Aug 18 17:06:23.564844 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 85/156] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:23 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:24.587153 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:24.589021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:24.597329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:24.598071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:24.598538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:24.603787 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:24.603787 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:24.603787 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:24.769746 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:24.775378 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:24.779679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fc98b242-fe7f-4736-8bc6-75235216d6de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.196892 Aug 18 17:06:24.793449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 72/157] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:24 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:25.800567 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:25.801468 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:25.808253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:25.808813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:25.809897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:25.811292 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:25.812307 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:25.812918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:25.998159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:26.002515 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cae29d79-a0fc-43fa-873a-ae5a3c55536c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.205698 Aug 18 17:06:26.003825 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 86/158] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:25 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:27.024328 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:27.025221 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:27.032241 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:27.032726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:27.033184 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:27.033921 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:27.034380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:27.034807 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:27.189389 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:27.197517 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1bc54d73-a6c4-49d1-b57a-39f51c1ff2ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.177462 Aug 18 17:06:27.198141 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 73/159] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:27 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:28.218098 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:28.218721 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:28.225220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:28.225650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:28.226154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:28.226858 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:28.227322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:28.227777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:28.366611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:28.375020 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c9c726a7-b221-416c-a9f9-52446b5b76d3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.160734 Aug 18 17:06:28.375649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 87/160] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:28 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:29.395379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:29.396017 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:29.403950 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:29.404428 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:29.404861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:29.405554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:29.406022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:29.406434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:29.556137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:29.564836 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fce01330-221e-4d56-a90c-f623633fcdee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.173187 Aug 18 17:06:29.565488 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 74/161] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:29 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:29.836440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:29.837122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:29.843853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:29.844427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:29.844968 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:29.845771 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:29.846309 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:29.846782 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:29.873804 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:06:30.265221 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-05907450-e6c7-4277-be9f-7aa768111715 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "DELETE /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 204 len: 0 microversion: 2.1 time: 0.432014 Aug 18 17:06:30.265889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 88/162] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:06:29 2022] DELETE /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 0 bytes in 434 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 17:06:30.274451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:30.275049 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:30.284203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:30.285064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:30.285658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:30.286656 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:30.287335 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:30.287950 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:30.438545 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:30.447260 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7c16c7c7-9d9a-4be8-bf14-ee365a1f53e9 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1555 microversion: 2.1 time: 0.177035 Aug 18 17:06:30.448317 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 75/163] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:30 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1555 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:30.587275 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:30.588088 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:30.594020 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:30.594513 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:30.603281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:30.603281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:30.603281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:30.603281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:30.762224 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:30.772502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b46ed72a-4c18-4e6e-a724-6dab096d5f0b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.189135 Aug 18 17:06:30.773740 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 89/164] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:30 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:31.468247 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:31.468858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:31.475409 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:31.475930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:31.476457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:31.477218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:31.477677 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:31.478103 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:31.614744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:31.624390 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-25777d1a-d17c-4cc4-81a0-c043c3760a02 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1555 microversion: 2.1 time: 0.160131 Aug 18 17:06:31.624963 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 76/165] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:31 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1555 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:31.794379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:31.795007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:31.801234 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:31.801844 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:31.804105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:31.804105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:31.804105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:31.804105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:31.964637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:31.972205 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-802dc9b9-63f2-4846-88d3-db6e5c53e9ad tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.182187 Aug 18 17:06:31.978459 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 90/166] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:31 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:32.650137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:32.650853 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:32.654660 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=67 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:32.658928 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:32.660268 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:32.660835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:32.661620 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:32.662183 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:32.662683 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:32.997785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:32.999870 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:33.016169 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:33.021841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:33.030699 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:33.034041 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:33.035624 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:33.036639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:33.055621 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:33.073548 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ffebb26f-abfd-4597-a757-582823d53c23 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1555 microversion: 2.1 time: 0.429968 Aug 18 17:06:33.090468 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 77/167] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:32 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1555 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:33.248511 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:33.257459 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2f6f086b-0d11-4485-8591-945bc6003763 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.264673 Aug 18 17:06:33.258337 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 91/168] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:32 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:33.734231 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-a67b87e9-427f-4f01-b8ed-f45a6c95d6c0 req-4f7ea64c-ae95-46fb-b492-295fa5f8fd07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "986651bb-c047-4346-9e7c-0f3e49a9cc8a", "name": "network-vif-deleted", "tag": "26906fcd-6e6c-4363-8218-2219658555d1"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:33.757806 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-a67b87e9-427f-4f01-b8ed-f45a6c95d6c0 req-4f7ea64c-ae95-46fb-b492-295fa5f8fd07 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:33.759221 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-a67b87e9-427f-4f01-b8ed-f45a6c95d6c0 req-4f7ea64c-ae95-46fb-b492-295fa5f8fd07 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:33.761594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-a67b87e9-427f-4f01-b8ed-f45a6c95d6c0 req-4f7ea64c-ae95-46fb-b492-295fa5f8fd07 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:33.793372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-a67b87e9-427f-4f01-b8ed-f45a6c95d6c0 req-4f7ea64c-ae95-46fb-b492-295fa5f8fd07 service nova] Creating event network-vif-deleted:26906fcd-6e6c-4363-8218-2219658555d1 for instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a on hv-cinder-85367 Aug 18 17:06:33.803461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-a67b87e9-427f-4f01-b8ed-f45a6c95d6c0 req-4f7ea64c-ae95-46fb-b492-295fa5f8fd07 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073694 Aug 18 17:06:33.810288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 78/169] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:06:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:06:34.094776 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:34.095392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:34.102212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:34.102712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:34.103144 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:34.105815 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:34.105815 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:34.105815 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:34.177008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:34.185304 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-df2b1d43-65c3-48a2-9638-d47f06eee9ad tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1346 microversion: 2.1 time: 0.094790 Aug 18 17:06:34.185892 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 92/170] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:34 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:34.282038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:34.282729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:34.289987 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:34.290859 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:34.291620 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:34.292563 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:34.293251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:34.294172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:34.499561 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:34.507376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8df8fa3d-97e3-4229-8a0d-b2daf97f0139 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.230469 Aug 18 17:06:34.508018 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 79/171] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:34 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:35.215698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:35.215698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:35.215698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:35.215698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:35.216410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:35.216410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:35.216410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:35.216410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:35.250741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:35.251225 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:35.251742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:35.252190 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lazy-loading 'fault' on Instance uuid 986651bb-c047-4346-9e7c-0f3e49a9cc8a {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:06:35.258716 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:35.299651 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3a4b4ea70c454bd59246e934403d04c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9fb6f2a098cb4ed4b93c4edb41ff2113', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:35.306962 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-683e90f1-213b-4624-b984-01710715043d tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 200 len: 1351 microversion: 2.1 time: 0.104939 Aug 18 17:06:35.307637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 93/172] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:35 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 1351 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:35.531535 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:35.532460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:35.539327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:35.540798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:35.540798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:35.541010 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:35.541530 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:35.541966 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:35.713437 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:35.721663 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-82c8a01f-80e2-4206-a4ab-457d0876bcf4 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.194079 Aug 18 17:06:35.722503 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 80/173] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:35 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:36.329358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:36.329965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:36.338377 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:36.340511 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:36.341265 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:36.345251 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:36.350061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:36.356525 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:36.378853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] HTTP exception thrown: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Request method failure captured: Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a HTTP/1.1 Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFj2R1CNLr_QSBZJ48GxilD_W4gnEhH1bG7eZrfa0DqTG_hEfA8pHJ2yfMh2YxQ-1Y4hhrfI-mrGp89xWxseeAWwOzbrMdBF5oIgLrAc60BrolSBnAR8aKyrwRruFvjUZGBZhHS811w0dR4WPiVaAJ5UpovbNvK7pNOm4M129l0cO8 Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 9fb6f2a098cb4ed4b93c4edb41ff2113 Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:06:36.397431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9fb6f2a098cb4ed4b93c4edb41ff2113", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 9fb6f2a098cb4ed4b93c4edb41ff2113 Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-DeleteServersTestJSON-977241467-project Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 3a4b4ea70c454bd59246e934403d04c2 Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-DeleteServersTestJSON-977241467-project Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.398568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '986651bb-c047-4346-9e7c-0f3e49a9cc8a'} Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:36.399268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.400447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.401504 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Returning 404 to user: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:36.401504 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0ae00d1a-b0e7-4094-a31b-44997551f919 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 404 len: 111 microversion: 2.1 time: 0.067755 Aug 18 17:06:36.401504 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 94/174] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:36 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:06:36.521558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:36.524612 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:36.531366 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:36.532064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:36.532625 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:36.533423 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:36.534236 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:36.534834 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:36.552950 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] HTTP exception thrown: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Request method failure captured: Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a/os-volume_attachments HTTP/1.1 Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFj2R1CNLr_QSBZJ48GxilD_W4gnEhH1bG7eZrfa0DqTG_hEfA8pHJ2yfMh2YxQ-1Y4hhrfI-mrGp89xWxseeAWwOzbrMdBF5oIgLrAc60BrolSBnAR8aKyrwRruFvjUZGBZhHS811w0dR4WPiVaAJ5UpovbNvK7pNOm4M129l0cO8 Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 9fb6f2a098cb4ed4b93c4edb41ff2113 Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:06:36.558113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9fb6f2a098cb4ed4b93c4edb41ff2113", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 9fb6f2a098cb4ed4b93c4edb41ff2113 Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-DeleteServersTestJSON-977241467-project Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 3a4b4ea70c454bd59246e934403d04c2 Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-DeleteServersTestJSON-977241467-project Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.559475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'server_id': '986651bb-c047-4346-9e7c-0f3e49a9cc8a'} Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:36.566011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:36.567945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:06:36.569457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Returning 404 to user: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:36.569457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-498b1dbd-ac6a-4220-a752-2245877735e4 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044424 Aug 18 17:06:36.569457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 81/175] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:06:36 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a/os-volume_attachments => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:06:36.745597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:36.746790 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:36.752958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:36.753710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:36.753850 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:36.754554 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:36.755010 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:36.755449 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:36.896560 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:36.905097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5ee0ebe3-9f43-42d1-89ed-afa13677547a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.163331 Aug 18 17:06:36.905665 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 95/176] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:36 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:37.925948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:37.926565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:37.933567 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:37.936221 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:37.936221 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:37.936221 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:37.936221 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:37.936600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:37.948576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:37.949641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:37.956469 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:37.956959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:37.957387 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:37.958077 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:37.958526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:37.958951 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:37.972934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] HTTP exception thrown: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Request method failure captured: Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a HTTP/1.1 Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFj2R1CNLr_QSBZJ48GxilD_W4gnEhH1bG7eZrfa0DqTG_hEfA8pHJ2yfMh2YxQ-1Y4hhrfI-mrGp89xWxseeAWwOzbrMdBF5oIgLrAc60BrolSBnAR8aKyrwRruFvjUZGBZhHS811w0dR4WPiVaAJ5UpovbNvK7pNOm4M129l0cO8 Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 9fb6f2a098cb4ed4b93c4edb41ff2113 Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:06:37.974474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9fb6f2a098cb4ed4b93c4edb41ff2113", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 9fb6f2a098cb4ed4b93c4edb41ff2113 Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-DeleteServersTestJSON-977241467-project Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 3a4b4ea70c454bd59246e934403d04c2 Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-DeleteServersTestJSON-977241467-project Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:37.975888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '986651bb-c047-4346-9e7c-0f3e49a9cc8a'} Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:37.976596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:37.977973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:37.979223 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Returning 404 to user: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:37.979223 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a2983b13-9c19-4ef9-8a69-b8c5f12bac4c tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "DELETE /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 404 len: 111 microversion: 2.1 time: 0.031147 Aug 18 17:06:37.979223 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 96/177] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:06:37 2022] DELETE /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:06:37.984064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:37.984689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] [instance: 986651bb-c047-4346-9e7c-0f3e49a9cc8a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:37.993861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:37.993861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:37.993861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:37.993861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:37.994438 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:37.994438 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:38.006697 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] HTTP exception thrown: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Request method failure captured: Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a HTTP/1.1 Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFj2R1CNLr_QSBZJ48GxilD_W4gnEhH1bG7eZrfa0DqTG_hEfA8pHJ2yfMh2YxQ-1Y4hhrfI-mrGp89xWxseeAWwOzbrMdBF5oIgLrAc60BrolSBnAR8aKyrwRruFvjUZGBZhHS811w0dR4WPiVaAJ5UpovbNvK7pNOm4M129l0cO8 Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 9fb6f2a098cb4ed4b93c4edb41ff2113 Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:06:38.008391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/9fb6f2a098cb4ed4b93c4edb41ff2113"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_9fb6f2a098cb4ed4b93c4edb41ff2113", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 9fb6f2a098cb4ed4b93c4edb41ff2113 Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-DeleteServersTestJSON-977241467 Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-DeleteServersTestJSON-977241467-project Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 3a4b4ea70c454bd59246e934403d04c2 Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-DeleteServersTestJSON-977241467-project Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:38.009810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '986651bb-c047-4346-9e7c-0f3e49a9cc8a'} Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:06:38.010598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. Aug 18 17:06:38.012698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:06:38.013830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] Returning 404 to user: Instance 986651bb-c047-4346-9e7c-0f3e49a9cc8a could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:06:38.013830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-209ad005-4d44-45eb-b65a-0af8ed2258a3 tempest-DeleteServersTestJSON-977241467 tempest-DeleteServersTestJSON-977241467-project] 10.222.0.78 "GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a" status: 404 len: 111 microversion: 2.1 time: 0.029327 Aug 18 17:06:38.013830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 97/178] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:37 2022] GET /compute/v2.1/servers/986651bb-c047-4346-9e7c-0f3e49a9cc8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:06:38.083049 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:38.092875 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-754217e4-00b4-447e-a60a-6cebf134d7a7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.170767 Aug 18 17:06:38.099513 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 82/179] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:37 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:38.411716 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-173455217", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "networks": [{"uuid": "98f13a32-2c3b-4f7d-a9ec-0ec548386443"}]}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:38.475219 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.network.neutron [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] validate_networks() for [('98f13a32-2c3b-4f7d-a9ec-0ec548386443', None, None, None, None, None)] {{(pid=121267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:06:39.114731 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:39.115302 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:39.123457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:39.124103 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:39.124420 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:39.125224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:39.125687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:39.126146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:39.314129 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:39.323429 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fb558f37-8693-4d20-9f54-9805458c7165 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.212728 Aug 18 17:06:39.324067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 83/180] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:39 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:39.457001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Flavor limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:06:39.461281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Image limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:06:39.461281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Flavor pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:06:39.461281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Image pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:06:39.461281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:06:39.470284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:39.470918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:39.471480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:39.472206 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:39.472686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:39.473088 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:39.496521 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Getting quotas for project 69a1c86410df4504b5f18a80623dceba. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:06:39.502426 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Getting quotas for user 19d658544130453ab0a9c08218195943 and project 69a1c86410df4504b5f18a80623dceba. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:06:39.518930 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Going to run 1 instances... {{(pid=121267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:06:39.522517 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:06:39.677853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-662ac078-8ee3-4302-afc5-183239bbedfb tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.270413 Aug 18 17:06:39.678541 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 98/181] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:06:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1272 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:06:39.689384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b1d954da-e943-414f-bbca-a2cb04fcdca2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:39.690062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b1d954da-e943-414f-bbca-a2cb04fcdca2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:39.784164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b1d954da-e943-414f-bbca-a2cb04fcdca2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:39.791876 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b1d954da-e943-414f-bbca-a2cb04fcdca2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1213 microversion: 2.1 time: 0.106235 Aug 18 17:06:39.792443 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 84/182] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:39 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1213 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:40.347039 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:40.347688 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:40.359354 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:40.361471 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:40.363485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:40.370520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:40.370780 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:40.371294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:40.581018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:40.594315 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2a50101f-8e46-4dd0-9218-ef07ee6fe9bd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.252660 Aug 18 17:06:40.602085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 99/183] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:40 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:40.818595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9bb52093-819c-4536-8001-33877be301c1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:40.819954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9bb52093-819c-4536-8001-33877be301c1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:40.914619 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9bb52093-819c-4536-8001-33877be301c1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:40.928026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9bb52093-819c-4536-8001-33877be301c1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1213 microversion: 2.1 time: 0.113377 Aug 18 17:06:40.929107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 85/184] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:40 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1213 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:41.615936 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:41.616646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:41.623497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:41.624081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:41.624681 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:41.625609 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:41.626084 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:41.626687 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:41.835229 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:41.856426 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-569192bd-3c29-4e78-94a4-94b606d455fd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.244403 Aug 18 17:06:41.869864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 100/185] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:41 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:41.952411 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:41.953229 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:41.960143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:41.960810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:41.961471 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:41.962286 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:41.962820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:41.963369 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:42.050702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:42.050702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7eae073a-6e4a-42f5-9687-540141aa4654 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1265 microversion: 2.1 time: 0.102582 Aug 18 17:06:42.063873 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 86/186] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:41 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:42.878126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:42.879278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:42.888763 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:42.889209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:42.895797 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:42.897036 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:42.897666 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:42.898258 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:43.063001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:43.073420 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:43.074711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:43.080883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3c687dde-ca43-40da-9927-d961d9f5b2cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.206533 Aug 18 17:06:43.083483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:43.083614 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 101/187] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:42 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:43.084871 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:43.084871 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:43.084871 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:43.084871 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:43.085711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:43.262497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:43.270256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-451cf461-ecca-4b02-9805-799e552a634a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1271 microversion: 2.1 time: 0.200561 Aug 18 17:06:43.270835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 87/188] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:43 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1271 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:44.102450 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:44.103097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:44.110452 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:44.111699 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:44.112333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:44.113783 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:44.114250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:44.114680 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:44.295415 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:44.296046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:44.305782 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:44.306144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:44.306595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:44.307348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:44.307808 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:44.308765 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:44.345888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:44.354906 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-72642f64-fcc6-44fd-82c2-58a2edc8a198 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.256407 Aug 18 17:06:44.355910 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 102/189] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:44 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:44.544914 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:44.558461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9bbe5ff6-b53d-47ea-a40a-6a3a9a208362 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.267685 Aug 18 17:06:44.574578 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 88/190] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:44 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:44.812562 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-efd35c76-5946-432e-9094-76585bc9655a req-f6ce05c9-59ba-44be-b9f2-0c98b02e2967 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ccc5298-562d-471e-b9b6-201fda0b0045", "tag": "30cfa317-17d6-438e-9ced-38f2feec236d"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:44.829085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-efd35c76-5946-432e-9094-76585bc9655a req-f6ce05c9-59ba-44be-b9f2-0c98b02e2967 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:44.829587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-efd35c76-5946-432e-9094-76585bc9655a req-f6ce05c9-59ba-44be-b9f2-0c98b02e2967 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:44.830027 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-efd35c76-5946-432e-9094-76585bc9655a req-f6ce05c9-59ba-44be-b9f2-0c98b02e2967 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:44.849000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-efd35c76-5946-432e-9094-76585bc9655a req-f6ce05c9-59ba-44be-b9f2-0c98b02e2967 service nova] Creating event network-changed:30cfa317-17d6-438e-9ced-38f2feec236d for instance 5ccc5298-562d-471e-b9b6-201fda0b0045 on hv-cinder-85367 Aug 18 17:06:44.859376 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-efd35c76-5946-432e-9094-76585bc9655a req-f6ce05c9-59ba-44be-b9f2-0c98b02e2967 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050810 Aug 18 17:06:44.860079 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 103/191] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:06:45.383884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:45.387548 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:45.399481 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:45.400430 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:45.404792 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:45.408733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:45.408733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:45.408733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:45.581620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:45.582313 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:45.589108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:45.589983 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:45.590842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:45.591716 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:45.592590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:45.598169 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:45.646031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:45.657064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c5a498b7-d73a-4ac2-94c1-0cd06b98c863 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.281333 Aug 18 17:06:45.658272 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 89/192] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:45 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:45.847644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:45.858570 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-59dc1c81-d63e-4e6f-8c0c-f7cf62ebb778 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.280644 Aug 18 17:06:45.871368 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 104/193] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:45 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:46.677445 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:46.678338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:46.685226 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:46.685716 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:46.686154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:46.686952 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:46.687412 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:46.687866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:46.880920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:46.882298 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:46.891069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:46.894303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:46.896724 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:46.898228 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:46.899792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:46.901874 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:46.928543 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:46.937231 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-97a5b864-2063-4260-8fd2-e10f43554e2b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.263717 Aug 18 17:06:46.956923 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 90/194] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:46 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:47.071132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:47.079208 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a6fdbf10-5911-4d04-8807-6d2ea2620946 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.202720 Aug 18 17:06:47.079802 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 105/195] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:46 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:47.971803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:47.972469 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:47.979475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:47.979721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:47.980558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:47.981256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:47.981713 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:47.982141 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:48.100216 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:48.100968 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:48.107677 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:48.108164 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:48.108602 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:48.109297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:48.109752 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:48.110178 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:48.113974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:48.122514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e4525830-cb80-4827-874e-4c17b8970f7a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.154704 Aug 18 17:06:48.123107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 91/196] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:47 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:48.243347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:48.251150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-25972ba7-8a59-4c4d-a117-10dace020a22 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.154819 Aug 18 17:06:48.251791 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 106/197] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:48 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:49.143455 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:49.144085 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:49.150484 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:49.150979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:49.151415 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:49.152206 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:49.153405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:49.153844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:49.275552 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:49.276180 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:49.284550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:49.285390 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:49.286226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:49.287238 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:49.287877 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:49.288827 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:49.328271 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:49.331907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=100 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:49.338352 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-442d8abf-d6c4-446e-9ac4-1c3c7aed4450 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.198836 Aug 18 17:06:49.338922 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 92/198] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:49 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:49.480448 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:49.483008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:49.489986 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-eac809ef-d456-4d79-9c89-1be99075a09a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.219985 Aug 18 17:06:49.490762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 107/199] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:49 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:50.360540 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:50.361313 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:50.369237 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:50.369982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:50.374514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:50.374514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:50.374514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:50.374514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:50.511670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:50.517479 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:50.517613 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:50.517725 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=6 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:50.520071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:50.520713 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:50.521563 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:50.522356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:50.522690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-34493c43-1430-431a-afbf-a0ed0301053e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.166251 Aug 18 17:06:50.522819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:50.523214 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:50.523678 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 93/200] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:50 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:50.650734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-c56853d4-baea-4221-bbfa-7ba0c28454b6 req-a14baffe-e2e6-4658-8267-a2ccb2188fe7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccc5298-562d-471e-b9b6-201fda0b0045", "name": "network-vif-plugged", "status": "completed", "tag": "30cfa317-17d6-438e-9ced-38f2feec236d"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:06:50.664748 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-c56853d4-baea-4221-bbfa-7ba0c28454b6 req-a14baffe-e2e6-4658-8267-a2ccb2188fe7 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:50.665586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-c56853d4-baea-4221-bbfa-7ba0c28454b6 req-a14baffe-e2e6-4658-8267-a2ccb2188fe7 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:50.666116 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-c56853d4-baea-4221-bbfa-7ba0c28454b6 req-a14baffe-e2e6-4658-8267-a2ccb2188fe7 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:50.678622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:50.679709 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-c56853d4-baea-4221-bbfa-7ba0c28454b6 req-a14baffe-e2e6-4658-8267-a2ccb2188fe7 service nova] Creating event network-vif-plugged:30cfa317-17d6-438e-9ced-38f2feec236d for instance 5ccc5298-562d-471e-b9b6-201fda0b0045 on hv-cinder-85367 Aug 18 17:06:50.684924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-c56853d4-baea-4221-bbfa-7ba0c28454b6 req-a14baffe-e2e6-4658-8267-a2ccb2188fe7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039213 Aug 18 17:06:50.685616 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 94/201] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:06:50.688617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b8e567d1-e758-452a-af31-ca2e97a5cdd2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.181484 Aug 18 17:06:50.689273 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 108/202] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:50 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:51.546113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:51.551944 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:51.551944 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=4 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:51.554352 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:51.554838 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:51.555270 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:51.556223 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:51.556679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:51.557111 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:51.710195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:51.710805 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:51.718775 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:51.719624 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:51.720019 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:51.724499 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:51.724499 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:51.724499 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:51.729103 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:51.737451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e79e25ee-b365-4405-8dda-974263b213f8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.196011 Aug 18 17:06:51.738043 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 95/203] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:51 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:51.863850 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:51.872242 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cfc58bdd-afef-43b2-bdd5-5ca9afed8582 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.165751 Aug 18 17:06:51.873124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 109/204] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:51 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:52.758777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:52.759396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:52.771629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:52.771629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:52.771629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:52.771629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:52.772148 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:52.772148 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:52.895169 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:52.895808 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:52.902146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:52.902894 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:52.903323 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:52.904051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:52.904505 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:52.904925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:52.911070 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:52.920760 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4439ff46-0376-404e-83e3-713ad58e1590 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.166461 Aug 18 17:06:52.921648 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 96/205] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:52 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:53.044047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:53.051857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c04e1fe8-7925-4a77-a52b-045072f48b69 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.160552 Aug 18 17:06:53.052434 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 110/206] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:52 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:53.941246 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:53.941882 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:53.948974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:53.949389 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:53.949817 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:53.950505 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:53.950960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:53.951377 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:54.073336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:54.074500 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:54.076463 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:54.081206 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:54.081688 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:54.082123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:54.082820 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:54.083275 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:54.083879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:54.086344 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:54.094356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3429334f-7692-4c66-8d85-05d979738989 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.156931 Aug 18 17:06:54.094932 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 97/207] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:53 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:54.225087 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:54.234203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1d7bf519-01ba-45ed-b972-6c0305104eb8 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.164764 Aug 18 17:06:54.234785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 111/208] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:54 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:55.115336 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:55.115982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:55.122438 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:55.122929 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:55.123387 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:55.129800 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:55.129800 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:55.129800 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:55.255550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:55.262736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:55.263486 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:55.263638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:55.263943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:55.264385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:55.265411 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:55.265522 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:55.265967 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:55.279721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5f7afb6a-8de9-4ec6-b6fa-10ef2687963f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.163344 Aug 18 17:06:55.280631 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 98/209] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:55 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:55.410524 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:55.418559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7109c115-607a-4717-b311-2c82442a141c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.167069 Aug 18 17:06:55.419134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 112/210] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:55 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:56.301392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:56.302054 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:56.308638 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:56.309129 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:56.309565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:56.310261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:56.310717 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:56.311146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:56.446649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:56.446649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:56.451746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:56.453461 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:56.454093 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:56.455290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:56.457042 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:56.457706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:56.458357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:56.471455 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-aecab71b-a2fb-4f57-9b2b-00a0ceee452c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.173533 Aug 18 17:06:56.475779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 99/211] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:56 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:56.480492 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:06:56.594347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:56.601964 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6436cd9a-563a-4f28-b3bc-7e7b0df1140d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.167069 Aug 18 17:06:56.602528 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 113/212] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:56 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:57.493102 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:57.493710 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:57.500941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:57.501417 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:57.501846 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:57.502531 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:57.502981 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:57.503396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:57.622712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:57.623603 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:57.629686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:57.630162 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:57.630717 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:57.631287 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:57.631760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:57.632187 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:57.634226 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:57.642392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fa3bd37c-6256-4dbe-b310-ab84b8f212fc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.153091 Aug 18 17:06:57.649669 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 100/213] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:57 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:57.764994 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:57.773007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f264b8a4-f0f2-4c71-919b-f7dd6b5f2563 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1313 microversion: 2.1 time: 0.154819 Aug 18 17:06:57.773564 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 114/214] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:57 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:06:58.664339 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:58.664969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:58.672112 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:58.672611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:58.673083 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:58.673813 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:58.674277 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:58.674715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:58.794203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:58.794818 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:58.801063 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:58.801559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:58.801994 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:58.802808 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:58.803276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:58.803769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:58.827096 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:58.835530 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b9b28db9-3409-4f1b-823d-727b5911840c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.175194 Aug 18 17:06:58.836400 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 101/215] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:58 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:58.958656 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:06:58.967536 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-04f82a69-fb5f-4d1b-92bb-904eb79019b9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1498 microversion: 2.1 time: 0.177062 Aug 18 17:06:58.968122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 115/216] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:58 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1498 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:06:59.856799 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:06:59.857317 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:06:59.863811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:59.864289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:59.864725 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:59.865405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:06:59.865850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:06:59.866356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:06:59.999804 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:00.008061 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6cb17ae4-99ad-4476-b48e-92f3a2dbe1dc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.155697 Aug 18 17:07:00.021691 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 102/217] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:06:59 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:01.029160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:01.029768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:01.035911 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:01.036393 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:01.036825 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:01.037512 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:01.037965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:01.038387 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:01.169379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:01.177494 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0f7ebffc-2a73-4622-a459-0e48b43a9c56 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.152199 Aug 18 17:07:01.178065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 116/218] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:01 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:02.199780 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:02.200402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:02.207660 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:02.208326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:02.208678 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:02.209309 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:02.209767 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:02.210194 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:02.353269 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:02.361359 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4626f0ce-4436-49c6-b937-32fcca997f23 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.166256 Aug 18 17:07:02.361927 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 103/219] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:02 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:02.751431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:02.751947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:02.758389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:02.759139 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:02.759608 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:02.760428 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:02.760883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:02.761495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:02.788337 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:07:03.131669 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8e637143-f12c-4b0e-be78-8491da810181 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 204 len: 0 microversion: 2.1 time: 0.383775 Aug 18 17:07:03.132275 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 117/220] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:07:02 2022] DELETE /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:07:03.141072 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:03.141715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:03.148130 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:03.148621 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:03.149058 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:03.149758 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:03.150217 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:03.150661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:03.298697 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:03.307641 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a506e00c-6cfe-4aa1-8516-f40e03d32265 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1504 microversion: 2.1 time: 0.170788 Aug 18 17:07:03.308229 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 104/221] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:03 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1504 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:03.383394 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:03.384218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:03.390655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:03.391132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:03.391598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:03.392291 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:03.392919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:03.397520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:03.527345 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:03.535636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-05dcfe38-dfa8-494e-a79c-990c747d691e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.156303 Aug 18 17:07:03.536208 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 118/222] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:03 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:04.330304 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:04.331035 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:04.333237 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=60 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:04.338097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:04.340542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:04.340542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:04.340542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:04.340542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:04.340981 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:04.501784 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:04.509460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-318f55f3-b11c-4fec-aef1-ae418ea95357 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1504 microversion: 2.1 time: 0.182973 Aug 18 17:07:04.509968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 105/223] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:04 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:04.557462 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:04.558808 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:04.566386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:04.567073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:04.567557 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:04.568259 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:04.568864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:04.569466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:04.717321 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:04.726844 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-27420030-d59a-4e78-b391-40d1c2751b7c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.173811 Aug 18 17:07:04.727465 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 119/224] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:04 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:05.531298 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:05.531978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:05.538357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:05.543205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:05.543205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:05.543205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:05.543205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:05.543577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:05.672589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:05.680391 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e1bf3b8a-900e-4cf2-8fa8-32f16b95444c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1504 microversion: 2.1 time: 0.152851 Aug 18 17:07:05.680874 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 106/225] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:05 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:05.748308 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:05.748920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:05.755105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:05.755627 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:05.756059 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:05.756749 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:05.757202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:05.757684 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:06.104657 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:06.112399 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-07197ebf-2774-471f-aeb0-8d9c5d181cc5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.367954 Aug 18 17:07:06.112974 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 120/226] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:05 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:06.701247 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:06.701946 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:06.708411 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:06.708899 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:06.709337 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:06.710032 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:06.710493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:06.710919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:06.842599 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:06.850188 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8eaeb7d0-7c99-4120-bfb0-10a72f2fe776 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1504 microversion: 2.1 time: 0.152785 Aug 18 17:07:06.850751 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 107/227] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:06 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:07.133279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:07.133918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:07.140659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:07.153919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:07.153919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:07.153919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:07.153919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:07.154374 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:07.271697 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:07.280023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-62e0c47c-23dd-4595-b1ea-762d0ae7f085 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1522 microversion: 2.1 time: 0.150621 Aug 18 17:07:07.280568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 121/228] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:07 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:07.872740 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:07.876357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:07.880105 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:07.880604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:07.881045 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:07.881753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:07.882208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:07.882739 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:08.109797 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:08.119323 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5d1cda3a-a13f-47d6-8095-fcec259bf508 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1504 microversion: 2.1 time: 0.250697 Aug 18 17:07:08.120675 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 108/229] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:07 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1504 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:08.300629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:08.301290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:08.309056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:08.309560 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:08.310187 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:08.311058 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:08.311698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:08.312279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:08.483812 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:08.493769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-dcae6ffb-2962-4bea-9eac-612e9c299689 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1502 microversion: 2.1 time: 0.196921 Aug 18 17:07:08.509429 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 122/230] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:08 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:08.514885 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:08.515497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:08.518719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-a22dd8e5-7819-4ce6-92b3-a13d92c3df48 req-96236376-07c7-43bc-894c-d4a6a244481f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ccc5298-562d-471e-b9b6-201fda0b0045", "name": "network-vif-deleted", "tag": "30cfa317-17d6-438e-9ced-38f2feec236d"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:08.523049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:08.523835 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:08.526574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:08.526574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:08.526574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:08.526574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:08.533662 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-a22dd8e5-7819-4ce6-92b3-a13d92c3df48 req-96236376-07c7-43bc-894c-d4a6a244481f service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:08.535694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-a22dd8e5-7819-4ce6-92b3-a13d92c3df48 req-96236376-07c7-43bc-894c-d4a6a244481f service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:08.536225 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-a22dd8e5-7819-4ce6-92b3-a13d92c3df48 req-96236376-07c7-43bc-894c-d4a6a244481f service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:08.548348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-a22dd8e5-7819-4ce6-92b3-a13d92c3df48 req-96236376-07c7-43bc-894c-d4a6a244481f service nova] Creating event network-vif-deleted:30cfa317-17d6-438e-9ced-38f2feec236d for instance 5ccc5298-562d-471e-b9b6-201fda0b0045 on hv-cinder-85367 Aug 18 17:07:08.553544 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-a22dd8e5-7819-4ce6-92b3-a13d92c3df48 req-96236376-07c7-43bc-894c-d4a6a244481f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058779 Aug 18 17:07:08.555327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 109/231] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:07:08.667274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:08.675026 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f4e27756-0180-4e1b-a1b0-b306516484f0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1516 microversion: 2.1 time: 0.164523 Aug 18 17:07:08.675643 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 123/232] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:08 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:09.142642 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:09.143492 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:09.150130 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:09.154726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:09.154726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:09.154726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:09.154726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:09.155077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:09.186653 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:09.187136 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:09.187584 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:09.188125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lazy-loading 'fault' on Instance uuid 5ccc5298-562d-471e-b9b6-201fda0b0045 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:07:09.195850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=100 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:09.242579 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:09.250912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-74619faf-98dd-4ef1-82c4-c9f03fa9347e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 200 len: 1303 microversion: 2.1 time: 0.113224 Aug 18 17:07:09.251500 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 110/233] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:09 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:10.278599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:10.279811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 5ccc5298-562d-471e-b9b6-201fda0b0045] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:10.285338 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:10.285814 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:10.286246 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:10.286935 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:10.287383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:10.287828 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:10.301386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] HTTP exception thrown: Instance 5ccc5298-562d-471e-b9b6-201fda0b0045 could not be found. Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Request method failure captured: Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 HTTP/1.1 Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nGc7vmX0M9DzTz9evQDph8BbH_PFf3Oar_avbLLV5u2feyCkWmTyY52nOBayTaG6k0HnFotUDbZETxFND9xt10xmn1VB71NcnLFGmLEYGQhp9LFZQ2KRWjIcUildV7PzWVsm4NWt2vkylu-jAwv6rj3ptIvwEYZUHz1JZ4s6Qo5LB4 Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 69a1c86410df4504b5f18a80623dceba Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-VolumesActionsTest-1738678888 Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:07:10.303150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/69a1c86410df4504b5f18a80623dceba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/69a1c86410df4504b5f18a80623dceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/69a1c86410df4504b5f18a80623dceba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_69a1c86410df4504b5f18a80623dceba", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-VolumesActionsTest-1738678888 Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 69a1c86410df4504b5f18a80623dceba Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-VolumesActionsTest-1738678888 Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-VolumesActionsTest-1738678888-project Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 19d658544130453ab0a9c08218195943 Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-VolumesActionsTest-1738678888-project Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 5ccc5298-562d-471e-b9b6-201fda0b0045 could not be found. Aug 18 17:07:10.304645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '5ccc5298-562d-471e-b9b6-201fda0b0045'} Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ccc5298-562d-471e-b9b6-201fda0b0045 could not be found. Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:07:10.305704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ccc5298-562d-471e-b9b6-201fda0b0045 could not be found. Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ccc5298-562d-471e-b9b6-201fda0b0045 could not be found. Aug 18 17:07:10.306852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:10.307902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Returning 404 to user: Instance 5ccc5298-562d-471e-b9b6-201fda0b0045 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:07:10.307902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a2bb7339-fd2f-4bd9-b207-b25676ed7f2f tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045" status: 404 len: 111 microversion: 2.1 time: 0.030291 Aug 18 17:07:10.307902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 124/234] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:10 2022] GET /compute/v2.1/servers/5ccc5298-562d-471e-b9b6-201fda0b0045 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:07:10.421977 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1285434261", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "networks": [{"uuid": "98f13a32-2c3b-4f7d-a9ec-0ec548386443"}]}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:10.500336 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] validate_networks() for [('98f13a32-2c3b-4f7d-a9ec-0ec548386443', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:07:10.554237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:10.556758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:10.563956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:10.564453 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:10.564886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:10.565592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:10.566493 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:10.568837 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:10.594551 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lazy-loading 'flavor' on Instance uuid 939d201c-6bc3-470f-9488-acd5f3ed99fd {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:07:10.890980 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d2d0c636-653f-4564-8ab8-fc9c4199cde0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd/action" status: 200 len: 32 microversion: 2.1 time: 0.340613 Aug 18 17:07:10.891892 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 125/235] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:07:10 2022] POST /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd/action => generated 32 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 17:07:10.904172 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:10.908336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:10.911063 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:10.911585 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:10.912086 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:10.912840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:10.913236 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:10.913656 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:11.079809 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:07:11.080520 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:07:11.081070 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:07:11.081516 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:07:11.081937 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:07:11.087638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:11.120664 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cff487a8-f8c3-4a18-a6b4-e8e01035d663 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.213178 Aug 18 17:07:11.120664 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 126/236] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:10 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:11.121386 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:11.121386 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:11.121386 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:11.121386 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:11.121825 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:11.123021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:11.148431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Getting quotas for project 69a1c86410df4504b5f18a80623dceba. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:07:11.150686 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Getting quotas for user 19d658544130453ab0a9c08218195943 and project 69a1c86410df4504b5f18a80623dceba. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:07:11.163261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:07:11.165994 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:07:11.342571 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9cc51db2-ec28-4968-8a47-cd157dfabbc2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.924723 Aug 18 17:07:11.343577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 111/237] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:07:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:07:11.354667 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d3d36f7f-ee52-423c-ad1d-ce428a024257 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:11.355281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d3d36f7f-ee52-423c-ad1d-ce428a024257 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:11.470902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d3d36f7f-ee52-423c-ad1d-ce428a024257 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:11.482691 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d3d36f7f-ee52-423c-ad1d-ce428a024257 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1214 microversion: 2.1 time: 0.128049 Aug 18 17:07:11.485558 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 127/238] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:11 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1214 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:12.141007 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:12.141646 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:12.150165 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:12.151175 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:12.151650 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:12.153991 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:12.153991 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:12.153991 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:12.309862 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:12.323253 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e8e19c76-6649-4182-942c-3701708f2498 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.182518 Aug 18 17:07:12.324236 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 112/239] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:12 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:12.507051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:12.507766 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:12.515111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:12.515903 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:12.516365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:12.517076 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:12.517536 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:12.517958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:12.558455 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:12.623235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:12.634225 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7acda202-dd1a-43c6-99dd-ccf20befb06d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1218 microversion: 2.1 time: 0.131645 Aug 18 17:07:12.636107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 128/240] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:12 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:13.344431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:13.345078 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:13.351824 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:13.356968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:13.356968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:13.356968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:13.356968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:13.357329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:13.504214 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:13.513379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-31856103-8c30-4632-95df-64c86c8afb40 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.172726 Aug 18 17:07:13.527198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 113/241] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:13 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:13.660933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:13.661552 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:13.668446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:13.668930 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:13.669364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:13.670059 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:13.670556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:13.670979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:13.745613 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:13.755606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9fe4a820-6a54-4f67-8024-d9604e2d2585 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1266 microversion: 2.1 time: 0.099153 Aug 18 17:07:13.756193 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 129/242] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:13 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:14.536480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:14.536480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:14.541854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:14.542332 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:14.542796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:14.543529 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:14.543927 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:14.544366 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:14.688038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:14.697187 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-295a0618-eea4-4a1a-a2a8-d0666c4e8d32 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.166733 Aug 18 17:07:14.711071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 114/243] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:14 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:14.777791 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:14.778399 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:14.784535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:14.785021 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:14.785453 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:14.786259 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:14.786874 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:14.787091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:14.852464 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:14.861170 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cdca4650-b316-42af-9ab6-59e7f4c84848 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1266 microversion: 2.1 time: 0.088037 Aug 18 17:07:14.861757 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 130/244] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:14 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:15.718369 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:15.720416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:15.725428 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:15.725919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:15.726364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:15.727072 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:15.727571 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:15.728006 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:15.882099 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:15.883100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:15.890092 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:15.890849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:15.891280 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:15.892016 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:15.892480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:15.893075 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:15.937679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:15.945962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6cc652d0-8aab-47e9-9804-443979b9ef2d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.231421 Aug 18 17:07:15.959722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 115/245] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:15 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:15.964141 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:15.972911 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0b641c6c-ff2c-4bac-a583-32a79d5b2b95 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1274 microversion: 2.1 time: 0.094582 Aug 18 17:07:15.973730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 131/246] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:15 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1274 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:16.968759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:16.969726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:16.977166 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:16.978747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:16.978747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:16.980089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:16.980770 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:16.981680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:17.000068 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:17.004818 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:17.009372 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:17.010516 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:17.011209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:17.014745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:17.015553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:17.030347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:17.133480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:17.148399 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c967eb31-6264-46c9-8d86-4ff000ae7145 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1272 microversion: 2.1 time: 0.153283 Aug 18 17:07:17.165217 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 132/247] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:16 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1272 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:17.278666 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:17.290298 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0d7b8370-30fa-4003-a21e-d7f346014f16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.324311 Aug 18 17:07:17.291460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 116/248] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:16 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:18.178722 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:18.179656 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:18.190594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:18.191102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:18.191576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:18.192453 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:18.193066 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:18.193644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:18.314163 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:18.314930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:18.336210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:18.336210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:18.341542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:18.342872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:18.344654 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:18.345339 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:18.487423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:18.497928 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fe4c9bef-fea5-4a4c-8177-b5589ca8006a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1314 microversion: 2.1 time: 0.323404 Aug 18 17:07:18.498563 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 133/249] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:18 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:18.624973 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:18.633561 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4234a25c-a7bf-4e72-8e8f-1b3f982022a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.323933 Aug 18 17:07:18.634301 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 117/250] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:18 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:18.783027 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-4e3e9a23-9802-4d13-8dda-af0fb441cd82 req-c7d66bb2-a7de-4b1b-b579-c6439ee5905c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72b7910f-db6b-4fb6-b112-4e9cf0967794", "tag": "8d5874da-2576-48f7-8764-b22e8f01cace"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:18.793524 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-4e3e9a23-9802-4d13-8dda-af0fb441cd82 req-c7d66bb2-a7de-4b1b-b579-c6439ee5905c service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:18.794037 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-4e3e9a23-9802-4d13-8dda-af0fb441cd82 req-c7d66bb2-a7de-4b1b-b579-c6439ee5905c service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:18.794436 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-4e3e9a23-9802-4d13-8dda-af0fb441cd82 req-c7d66bb2-a7de-4b1b-b579-c6439ee5905c service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:18.806018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-4e3e9a23-9802-4d13-8dda-af0fb441cd82 req-c7d66bb2-a7de-4b1b-b579-c6439ee5905c service nova] Creating event network-changed:8d5874da-2576-48f7-8764-b22e8f01cace for instance 72b7910f-db6b-4fb6-b112-4e9cf0967794 on hv-cinder-85367 Aug 18 17:07:18.812027 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-4e3e9a23-9802-4d13-8dda-af0fb441cd82 req-c7d66bb2-a7de-4b1b-b579-c6439ee5905c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032750 Aug 18 17:07:18.813248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 134/251] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:07:19.522194 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:19.522986 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:19.537311 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:19.538726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:19.539957 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:19.540866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:19.542261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:19.542993 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:19.657257 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:19.658737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:19.670171 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:19.670623 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:19.671055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:19.677045 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:19.677602 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:19.677846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:19.841279 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:19.852482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9f3577c8-9947-41c3-9713-c93ad4aaeff9 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1314 microversion: 2.1 time: 0.334956 Aug 18 17:07:19.854623 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 118/252] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:19 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:20.009184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:20.020953 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-17e2470d-4069-46b8-b35d-7a11309757e1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.367508 Aug 18 17:07:20.022003 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 135/253] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:19 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:20.874232 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:20.875527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:20.882531 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:20.883231 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:20.886978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:20.886978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:20.886978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:20.886978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:21.043368 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:21.044111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:21.050752 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:21.051507 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:21.052387 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:21.053327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:21.054015 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:21.054651 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:21.133497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:21.140787 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:21.153679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d73bacf8-9e64-48b8-9e58-e3553dcfee6e tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1314 microversion: 2.1 time: 0.283116 Aug 18 17:07:21.165274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 119/254] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:20 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:21.230545 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:21.241922 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-32464a5a-fcdc-4a19-aca5-c60e15b614d9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.202997 Aug 18 17:07:21.250610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 136/255] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:21 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:21.460391 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-81f6bfb4-3c0e-45fc-b4ae-8e91b7c4a598 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:21.462662 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-81f6bfb4-3c0e-45fc-b4ae-8e91b7c4a598 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:21.470811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=6 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:21.472792 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81f6bfb4-3c0e-45fc-b4ae-8e91b7c4a598 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:21.473486 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81f6bfb4-3c0e-45fc-b4ae-8e91b7c4a598 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:21.474366 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81f6bfb4-3c0e-45fc-b4ae-8e91b7c4a598 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:21.475340 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81f6bfb4-3c0e-45fc-b4ae-8e91b7c4a598 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:21.476018 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81f6bfb4-3c0e-45fc-b4ae-8e91b7c4a598 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:21.477266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81f6bfb4-3c0e-45fc-b4ae-8e91b7c4a598 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:21.510866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-81f6bfb4-3c0e-45fc-b4ae-8e91b7c4a598 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/ips" status: 200 len: 152 microversion: 2.20 time: 0.058605 Aug 18 17:07:21.511854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 120/256] 10.222.0.78 () {60 vars in 1289 bytes} [Thu Aug 18 17:07:21 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/ips => generated 152 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:07:22.178526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:22.180066 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:22.183365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:22.194385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:22.195596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:22.197789 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:22.199599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:22.201304 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:22.202378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:22.266994 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:22.268741 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:22.277379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:22.278732 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:22.279415 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:22.281091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:22.281779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:22.282367 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:22.455917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:22.465288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bc1ec002-12be-43b8-9042-bce84bbcefea tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1314 microversion: 2.1 time: 0.291182 Aug 18 17:07:22.466264 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 137/257] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:22 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:22.601307 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:22.617475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2b0d08ab-59ae-4ef3-ad66-a4d2f5cfe81b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.357091 Aug 18 17:07:22.622555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 121/258] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:22 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:23.099999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5d6bbd89-9732-497e-bc66-c161e3f3ee70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:23.101428 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5d6bbd89-9732-497e-bc66-c161e3f3ee70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:23.110155 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6bbd89-9732-497e-bc66-c161e3f3ee70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:23.115887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6bbd89-9732-497e-bc66-c161e3f3ee70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:23.115887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6bbd89-9732-497e-bc66-c161e3f3ee70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:23.115887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6bbd89-9732-497e-bc66-c161e3f3ee70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:23.115887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6bbd89-9732-497e-bc66-c161e3f3ee70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:23.116261 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6bbd89-9732-497e-bc66-c161e3f3ee70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:23.148183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5d6bbd89-9732-497e-bc66-c161e3f3ee70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/ips" status: 200 len: 151 microversion: 2.1 time: 0.053314 Aug 18 17:07:23.149461 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 138/259] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:07:23 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/ips => generated 151 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:07:23.493527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:23.493527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:23.522719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:23.523543 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:23.524246 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:23.525364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:23.525974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:23.526562 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:23.658385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:23.659965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:23.675381 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:23.676109 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:23.678217 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:23.679266 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:23.679967 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:23.680598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:23.775823 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:23.812881 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1639447e-94e7-40b9-8f0c-3a9a022f6a44 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1314 microversion: 2.1 time: 0.329221 Aug 18 17:07:23.813522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 122/260] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:23 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:23.858617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:23.867282 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a6b23a04-4ef3-4dcb-8256-5678025c9994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.222425 Aug 18 17:07:23.868487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 139/261] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:23 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:24.817665 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-b3d612ed-fe5c-459d-a5d6-2cb547e1e841 req-42f9010d-83af-4a41-b045-58ebbd90a4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b7910f-db6b-4fb6-b112-4e9cf0967794", "name": "network-vif-plugged", "status": "completed", "tag": "8d5874da-2576-48f7-8764-b22e8f01cace"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:24.844838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:24.845476 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:24.865165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:24.865658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:24.866098 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:24.866802 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:24.873523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:24.874528 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:24.876117 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b3d612ed-fe5c-459d-a5d6-2cb547e1e841 req-42f9010d-83af-4a41-b045-58ebbd90a4b5 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:24.876946 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b3d612ed-fe5c-459d-a5d6-2cb547e1e841 req-42f9010d-83af-4a41-b045-58ebbd90a4b5 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:24.877843 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b3d612ed-fe5c-459d-a5d6-2cb547e1e841 req-42f9010d-83af-4a41-b045-58ebbd90a4b5 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:24.915056 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-b3d612ed-fe5c-459d-a5d6-2cb547e1e841 req-42f9010d-83af-4a41-b045-58ebbd90a4b5 service nova] Creating event network-vif-plugged:8d5874da-2576-48f7-8764-b22e8f01cace for instance 72b7910f-db6b-4fb6-b112-4e9cf0967794 on hv-cinder-85367 Aug 18 17:07:24.929480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-b3d612ed-fe5c-459d-a5d6-2cb547e1e841 req-42f9010d-83af-4a41-b045-58ebbd90a4b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116108 Aug 18 17:07:24.932881 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 123/262] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:07:24.956646 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:24.975753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:25.023487 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:25.029038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:25.029887 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:25.035250 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:25.035250 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:25.035250 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:25.136190 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lazy-loading 'flavor' on Instance uuid 68e481aa-bf5a-436b-baca-f5c8b88de401 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:07:25.272793 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:25.285601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f04ee97d-865d-454b-8dcc-475b3f8ca72d tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1314 microversion: 2.1 time: 0.450989 Aug 18 17:07:25.287371 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 140/263] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:24 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1314 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:25.302800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:25.303598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:25.318483 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:25.318995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:25.319613 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:25.320336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:25.320988 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:25.321439 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:25.622847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:25.635162 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8f7cb540-e695-42bb-a95e-9031ed1d4c9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.344395 Aug 18 17:07:25.652592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 141/264] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:25 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:25.662580 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1918ddb6-8970-4a01-ba62-34b42562d365 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bb385ea-4cff-4bdd-bbc0-97b100bac9fd"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:25.668124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1918ddb6-8970-4a01-ba62-34b42562d365 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:25.677584 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=69,nova_api:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:25.679531 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1918ddb6-8970-4a01-ba62-34b42562d365 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:25.680277 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1918ddb6-8970-4a01-ba62-34b42562d365 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:25.680926 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1918ddb6-8970-4a01-ba62-34b42562d365 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:25.682651 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1918ddb6-8970-4a01-ba62-34b42562d365 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:25.683340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1918ddb6-8970-4a01-ba62-34b42562d365 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:25.684024 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1918ddb6-8970-4a01-ba62-34b42562d365 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:25.908181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3c472cde-f84f-4bcb-8697-0200a90f2fc4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/action" status: 202 len: 0 microversion: 2.20 time: 0.971181 Aug 18 17:07:25.909669 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 124/265] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Aug 18 17:07:24 2022] POST /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/action => generated 0 bytes in 976 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:07:25.919381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:25.922163 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:25.934566 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:25.935479 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:25.935904 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:25.936777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:25.937250 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:25.938176 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:26.130213 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:26.142866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:26.144663 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:26.146529 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7fa073c4-621e-48d7-9c85-a19c565a1e5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.231393 Aug 18 17:07:26.160218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 125/266] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:25 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:26.309019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:26.309644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:26.318267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:26.318771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:26.319209 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:26.319963 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:26.320550 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:26.320852 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:26.524259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:26.529431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:26.534742 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7acb31a9-29bd-4b53-b6b1-87840b9d8ae1 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1314 microversion: 2.1 time: 0.230207 Aug 18 17:07:26.535873 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 126/267] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:26 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:26.673629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:26.673629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:26.679987 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:26.680879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:26.682288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:26.683170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:26.683841 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:26.684453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:26.860115 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:26.883841 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-190aace8-5afa-4ad7-ab33-c624bd17f885 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.226936 Aug 18 17:07:26.885330 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 127/268] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:26 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:27.173479 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:27.175140 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:27.209344 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:27.211993 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:27.212728 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:27.214501 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:27.216008 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:27.216584 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:27.539953 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:27.552565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:27.563724 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:27.565023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9852f80d-3ef4-4543-85ef-db12aca33c94 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.397540 Aug 18 17:07:27.566578 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 128/269] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:27 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:07:27.572820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:27.573812 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:27.597311 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:27.598210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:27.598817 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:27.599859 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:27.600733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:27.601391 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:27.881652 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:27.890922 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-336ef7f1-d1b5-4842-8455-1c303e897ff7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1314 microversion: 2.1 time: 0.322748 Aug 18 17:07:27.891533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 129/270] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:27 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:27.913848 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:27.914542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:27.921855 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:27.922959 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:27.923824 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:27.924850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:27.925568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:27.926190 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:27.965637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1918ddb6-8970-4a01-ba62-34b42562d365 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.311279 Aug 18 17:07:27.966536 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 142/271] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:07:25 2022] POST /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments => generated 194 bytes in 2313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:07:28.138026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:28.146869 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7a981d65-5478-4277-a409-e38f79bfd501 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.237074 Aug 18 17:07:28.161536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 130/272] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:27 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:28.592749 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:28.593785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:28.601234 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:28.601949 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:28.602803 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:28.604362 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:28.607579 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:28.608204 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:28.897765 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:28.912517 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:28.913279 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:28.913903 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:28.922876 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:28.922876 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-97ed3c53-2c95-453f-b0c8-15eb37b72958 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.331728 Aug 18 17:07:28.922876 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 143/273] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:28 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:28.925675 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:28.926183 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:28.926629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:28.927348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:28.927842 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:28.928341 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:29.169364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:29.169970 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:29.183745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:29.184540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:29.185169 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:29.185918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:29.188177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:29.188730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:29.201549 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:29.211610 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f325a6a2-b518-4ff8-8b5f-277ddfc08831 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1499 microversion: 2.1 time: 0.302618 Aug 18 17:07:29.211900 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:29.227281 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 131/274] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:28 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1499 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:29.439356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:29.448056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8efd80fe-b9a0-4661-a76a-5cc7657b6c4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.282605 Aug 18 17:07:29.448706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 144/275] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:29 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:29.945409 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:29.946022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:29.953466 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:29.953954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:29.954390 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:29.955088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:29.955563 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:29.956173 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:30.151023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:30.164632 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:30.167181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:30.168616 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f27ad109-b43d-4328-8da7-ba53d5f62851 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.228456 Aug 18 17:07:30.185635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 132/276] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:29 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:30.339211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:30.339945 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:30.347710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:30.348737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:30.349826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:30.350722 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:30.351381 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:30.352360 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:30.386929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:07:30.470319 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:30.471104 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:30.478664 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:30.479169 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:30.479858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:30.480966 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:30.482113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:30.482711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:30.814379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-74dba96d-1c5d-4e0a-b61f-218b41c3c5d7 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "DELETE /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 204 len: 0 microversion: 2.1 time: 0.479517 Aug 18 17:07:30.815987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 145/277] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:07:30 2022] DELETE /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:07:30.825155 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:30.826198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:30.842536 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:30.843043 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:30.843519 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:30.844563 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:30.845214 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:30.845798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:30.860366 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:30.871931 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9e358510-970d-4be9-8d87-4d81b6e945bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.404685 Aug 18 17:07:30.876416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 133/278] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:30 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:31.085925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:31.099280 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-372df7c8-ec0c-468b-8524-6994c2bc0ee2 tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1505 microversion: 2.1 time: 0.278810 Aug 18 17:07:31.100346 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 146/279] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:30 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1505 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:31.197688 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:31.199979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:31.208020 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:31.208846 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:31.209869 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:31.210907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:31.211537 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:31.212105 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:31.404989 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:31.414526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:31.416872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:31.418170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-72213c0e-be7b-4cba-8bf4-5f89fc13d2ad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.225374 Aug 18 17:07:31.418812 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 134/280] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:31 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:31.902677 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:31.903294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:31.912587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:31.913616 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:31.914435 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:31.915429 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:31.925379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:31.926025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:32.101112 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:32.109933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cfaa63d1-3051-46af-8701-66423905a00b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.213202 Aug 18 17:07:32.110803 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 147/281] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:31 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:32.124035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:32.125138 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:32.132664 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:32.133405 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:32.142532 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:32.142532 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:32.142532 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:32.142532 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:32.302402 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:32.313610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-eb228d3d-f88a-4766-9d86-a482c5593b9c tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1505 microversion: 2.1 time: 0.194282 Aug 18 17:07:32.314482 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 148/282] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:32 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:32.343936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-52ccf0b2-c4ff-4fea-a6d0-c01281e69875 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Action: 'create', calling method: .version_select at 0x7ff5b58f50d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1795979929", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBsU77yKb5aSJd7pMtYq3KETrzC2krIUOPRc8OJfA3e6PLzshKrTAnWaaWgGxR8XEMhxTo7cLoVNV+EYsJiMo068Uo9z7pZomNbAPuffnuIsGXuZ2uGlIXkdLNarHVGiBw=="}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:32.366900 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-52ccf0b2-c4ff-4fea-a6d0-c01281e69875 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Getting quotas for project e5d8cae49e524a98ae646381b455351e. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:07:32.375860 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-52ccf0b2-c4ff-4fea-a6d0-c01281e69875 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Getting quotas for user 99010fd86e3b4bf59fc39716d208f06f and project e5d8cae49e524a98ae646381b455351e. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:07:32.441785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:32.442405 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:32.448550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:32.449033 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:32.449469 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:32.451394 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:32.451893 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:32.452127 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-52ccf0b2-c4ff-4fea-a6d0-c01281e69875 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.367599 Aug 18 17:07:32.452430 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:32.452741 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 135/283] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:07:32 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:07:32.603327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:32.612281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:32.613964 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:32.615198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0e59067f-5a11-44f7-b81b-294bfac8f358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.177452 Aug 18 17:07:32.623578 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 149/284] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:32 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:33.136134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:33.136772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:33.145489 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:33.146242 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:33.146870 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:33.147919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:33.148569 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:33.149235 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:33.236104 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-183300f9-a5ed-4d88-a375-59c87e12cd46 req-b9595bbc-bcc9-4355-8965-382cc06e46f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72b7910f-db6b-4fb6-b112-4e9cf0967794", "name": "network-vif-deleted", "tag": "8d5874da-2576-48f7-8764-b22e8f01cace"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:33.246409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-183300f9-a5ed-4d88-a375-59c87e12cd46 req-b9595bbc-bcc9-4355-8965-382cc06e46f6 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:33.246887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-183300f9-a5ed-4d88-a375-59c87e12cd46 req-b9595bbc-bcc9-4355-8965-382cc06e46f6 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:33.247365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-183300f9-a5ed-4d88-a375-59c87e12cd46 req-b9595bbc-bcc9-4355-8965-382cc06e46f6 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:33.259745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-183300f9-a5ed-4d88-a375-59c87e12cd46 req-b9595bbc-bcc9-4355-8965-382cc06e46f6 service nova] Creating event network-vif-deleted:8d5874da-2576-48f7-8764-b22e8f01cace for instance 72b7910f-db6b-4fb6-b112-4e9cf0967794 on hv-cinder-85367 Aug 18 17:07:33.266316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-183300f9-a5ed-4d88-a375-59c87e12cd46 req-b9595bbc-bcc9-4355-8965-382cc06e46f6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033895 Aug 18 17:07:33.267973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 150/285] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:07:33.339734 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:33.341441 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:33.367250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:33.369138 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:33.369595 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:33.371003 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:33.371524 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:33.374029 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:33.386910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:33.397540 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-92d70945-f5b2-4c5c-b21d-46dc95dc3699 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.269353 Aug 18 17:07:33.398290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 136/286] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:33 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:33.542152 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:33.554006 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f8d2d00d-76dc-4588-9735-8a75feebf5cc tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1463 microversion: 2.1 time: 0.222710 Aug 18 17:07:33.556456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 151/287] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:33 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1463 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:33.640995 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:33.641699 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:33.649087 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:33.649655 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:33.651527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:33.651527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:33.651527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:33.653155 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:33.998623 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:34.012856 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:34.015179 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:34.016604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b824a870-a7a9-464a-af81-b5d6acbd0d1f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.382219 Aug 18 17:07:34.031401 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 137/288] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:33 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:34.424157 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:34.425112 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:34.432376 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:34.432882 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:34.433293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:34.434530 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:34.434687 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:34.435130 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:34.578872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:34.579527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:34.581404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:34.593942 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:34.594447 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:34.594892 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:34.595651 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:34.596110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:34.603563 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:34.632388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:34.643523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1b62b47d-cc1d-457f-ab06-4186733e4218 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.222456 Aug 18 17:07:34.643523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 152/289] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:34 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:34.666637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:34.667543 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:34.668183 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:34.668834 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lazy-loading 'fault' on Instance uuid 72b7910f-db6b-4fb6-b112-4e9cf0967794 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:07:34.731520 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d658544130453ab0a9c08218195943', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '69a1c86410df4504b5f18a80623dceba', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:34.739577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-dd58cdeb-7115-40a7-8b81-db485132567a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 200 len: 1304 microversion: 2.1 time: 0.164909 Aug 18 17:07:34.740152 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 138/290] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:34 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 1304 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:35.041235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:35.041853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:35.048379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:35.052059 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:35.052059 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:35.052059 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:35.052059 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:35.052376 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:35.242035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:35.251546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:35.253860 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:35.255513 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0a43b496-dd20-425a-b6ff-56a06aa6a2ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.219020 Aug 18 17:07:35.256647 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 153/291] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:35 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:35.682077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:35.683763 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:35.704417 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:35.705261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:35.706157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:35.707047 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:35.708211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:35.708805 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:35.761859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:35.768612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] [instance: 72b7910f-db6b-4fb6-b112-4e9cf0967794] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:35.776462 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:35.777268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:35.777770 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:35.778553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:35.779157 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:35.779754 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:35.801760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] HTTP exception thrown: Instance 72b7910f-db6b-4fb6-b112-4e9cf0967794 could not be found. Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Request method failure captured: Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 HTTP/1.1 Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nGc7vmX0M9DzTz9evQDph8BbH_PFf3Oar_avbLLV5u2feyCkWmTyY52nOBayTaG6k0HnFotUDbZETxFND9xt10xmn1VB71NcnLFGmLEYGQhp9LFZQ2KRWjIcUildV7PzWVsm4NWt2vkylu-jAwv6rj3ptIvwEYZUHz1JZ4s6Qo5LB4 Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 69a1c86410df4504b5f18a80623dceba Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-VolumesActionsTest-1738678888 Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:07:35.803550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/69a1c86410df4504b5f18a80623dceba"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/69a1c86410df4504b5f18a80623dceba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/69a1c86410df4504b5f18a80623dceba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_69a1c86410df4504b5f18a80623dceba", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-VolumesActionsTest-1738678888 Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 69a1c86410df4504b5f18a80623dceba Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-VolumesActionsTest-1738678888 Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-VolumesActionsTest-1738678888-project Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 19d658544130453ab0a9c08218195943 Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-VolumesActionsTest-1738678888-project Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 72b7910f-db6b-4fb6-b112-4e9cf0967794 could not be found. Aug 18 17:07:35.804753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '72b7910f-db6b-4fb6-b112-4e9cf0967794'} Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72b7910f-db6b-4fb6-b112-4e9cf0967794 could not be found. Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:07:35.805470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72b7910f-db6b-4fb6-b112-4e9cf0967794 could not be found. Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72b7910f-db6b-4fb6-b112-4e9cf0967794 could not be found. Aug 18 17:07:35.806617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:35.807767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] Returning 404 to user: Instance 72b7910f-db6b-4fb6-b112-4e9cf0967794 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:07:35.807767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-70258c55-d557-4843-869f-015b2578131a tempest-VolumesActionsTest-1738678888 tempest-VolumesActionsTest-1738678888-project] 10.222.0.78 "GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794" status: 404 len: 111 microversion: 2.1 time: 0.047641 Aug 18 17:07:35.807767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 154/292] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:35 2022] GET /compute/v2.1/servers/72b7910f-db6b-4fb6-b112-4e9cf0967794 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:07:35.909148 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:35.919820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6e38373b-7c47-4578-aa8f-8ebf0c8bd040 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1502 microversion: 2.1 time: 0.244924 Aug 18 17:07:35.921244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 139/293] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:35 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1502 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:35.944402 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "517cada4-5b79-4ccd-a406-8e75c51aef44"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:35.947784 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:35.955178 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:35.955799 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:35.956247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:35.957133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:35.957594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:35.958453 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:36.003569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] HTTP exception thrown: Cannot 'attach_volume' instance 939d201c-6bc3-470f-9488-acd5f3ed99fd while it is in vm_state rescued Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Request method failure captured: Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: POST /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd/os-volume_attachments HTTP/1.1 Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 74 Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFhH2yYX7xcdPCDSwWtSZHmnOE-W47U9s3JNZq7u1jv_RuXGKvu0b-fH9zNDVd5do94K1mzWLrv10OXD1Mlrr-WZ-r-XBg5yRUddndOLc3xkh9Q0nGpQt2Lqry8y5fv1tlt3ceTLX_8FOb6Js9mKZropmkuIjqsUIAy79tdGEJS88U Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:07:36.005167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ccc5c89023ff476ca3b85680f56f8899", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: a3bc033664c445f78b9d67440876c19d Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {"volumeAttachment": {"volumeId": "517cada4-5b79-4ccd-a406-8e75c51aef44"}} Aug 18 17:07:36.006456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Cannot 'attach_volume' instance 939d201c-6bc3-470f-9488-acd5f3ed99fd while it is in vm_state rescued Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'server_id': '939d201c-6bc3-470f-9488-acd5f3ed99fd', 'body': {'volumeAttachment': {'volumeId': '517cada4-5b79-4ccd-a406-8e75c51aef44'}}} Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 939d201c-6bc3-470f-9488-acd5f3ed99fd in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:07:36.007281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 939d201c-6bc3-470f-9488-acd5f3ed99fd while it is in vm_state rescued Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:07:36.008568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:07:36.009642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:07:36.009642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:07:36.009642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 939d201c-6bc3-470f-9488-acd5f3ed99fd while it is in vm_state rescued Aug 18 17:07:36.009642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:07:36.009642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Returning 409 to user: Cannot 'attach_volume' instance 939d201c-6bc3-470f-9488-acd5f3ed99fd while it is in vm_state rescued {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:07:36.009642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-00b5fed5-de2d-4136-a666-85437063d913 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.069106 Aug 18 17:07:36.009642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 155/294] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:07:35 2022] POST /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd/os-volume_attachments => generated 152 bytes in 70 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 17:07:36.016048 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ab4cffaf-6eae-4aeb-90c7-16a7f8cf6f2c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:36.016904 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ab4cffaf-6eae-4aeb-90c7-16a7f8cf6f2c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:36.029474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ab4cffaf-6eae-4aeb-90c7-16a7f8cf6f2c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:36.030185 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ab4cffaf-6eae-4aeb-90c7-16a7f8cf6f2c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:36.030626 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ab4cffaf-6eae-4aeb-90c7-16a7f8cf6f2c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:36.031342 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ab4cffaf-6eae-4aeb-90c7-16a7f8cf6f2c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:36.031835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ab4cffaf-6eae-4aeb-90c7-16a7f8cf6f2c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:36.032268 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ab4cffaf-6eae-4aeb-90c7-16a7f8cf6f2c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:36.277828 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ab4cffaf-6eae-4aeb-90c7-16a7f8cf6f2c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd/action" status: 202 len: 0 microversion: 2.1 time: 0.265671 Aug 18 17:07:36.278796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 140/295] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:07:36 2022] POST /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd/action => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 17:07:36.284870 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:36.285478 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:36.289158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:36.289930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:36.291693 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:36.292205 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:36.292608 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:36.293297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:36.293925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:36.294346 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:36.297225 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:36.297719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:36.299722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:36.299722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:36.299722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:36.300086 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:36.517823 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:36.529011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ce974c92-56ab-45c2-9373-8190e8f052bb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1510 microversion: 2.1 time: 0.245170 Aug 18 17:07:36.532402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 141/296] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:36 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1510 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:36.551341 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:36.560314 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:36.561804 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:36.562959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b975bc73-d3f1-4a76-91f6-69cdbddec07c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.282101 Aug 18 17:07:36.563526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 156/297] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:36 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:37.551090 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:37.552428 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:37.561189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:37.561746 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:37.562278 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:37.562938 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:37.563477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:37.563905 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:37.601065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:37.601065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:37.601065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:37.601065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:37.601795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:37.602378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:37.603069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:37.603767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:37.739748 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:37.748378 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-58534fe1-a326-4253-b203-f24026a92ea2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1510 microversion: 2.1 time: 0.201423 Aug 18 17:07:37.748953 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 142/298] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:37 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1510 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:37.761358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:37.771982 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:37.774190 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:37.775843 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1a13bf85-bb82-4da4-8e29-a722ba74bf9a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.189629 Aug 18 17:07:37.786053 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 157/299] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:37 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:07:38.773026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:38.773684 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:38.787877 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:38.787877 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:38.787877 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:38.787877 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:38.788252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:38.788252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:38.793637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:38.808166 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:38.808865 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:38.817914 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:38.818414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:38.818851 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:38.819574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:38.820051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:38.820473 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:39.058126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:39.067062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:39.068508 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:39.070770 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:39.072028 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ac1e63dd-a368-46ba-aade-3a59ff576729 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.267795 Aug 18 17:07:39.076370 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ee453fba-ce91-4257-baa5-48d9061289a0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1510 microversion: 2.1 time: 0.310329 Aug 18 17:07:39.082150 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 143/300] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:38 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1510 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:39.088333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 158/301] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:38 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:07:40.092734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c5e35caf-5596-4eed-ace1-8d9d35e1b758 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: .version_select at 0x7ff5b56df3a0>, body: {"keypair": {"name": "tempest-keypair-665410517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH14A3pz26JP8NMb/mk9yJEWbVTPmTof03uekP3nSS+3EzrKt2X9JhD+VMUwGxp4sWm+xr2B5zdgBVYimBf2IPGsP7AMta/IM/K+rkofmwCvozP6MpczSp9LWUhY7mZK4g=="}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:40.096859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:40.097863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:40.104910 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:40.105653 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:40.106597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:40.107307 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:40.107864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:40.108285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:40.110372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-c5e35caf-5596-4eed-ace1-8d9d35e1b758 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for project 4eececcd804446e49078038ab362b235. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:07:40.114604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-c5e35caf-5596-4eed-ace1-8d9d35e1b758 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for user 1fec6bdfe9ee4e839efaf7a1c083c31d and project 4eececcd804446e49078038ab362b235. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:07:40.241044 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:40.250617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:40.252194 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:40.253380 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a3817d3b-3f8f-47f8-93fc-ea3fff9c56c7 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.160827 Aug 18 17:07:40.254083 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 159/302] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:40 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:07:40.258402 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:40.259046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:40.265566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:40.266047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:40.266478 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:40.267166 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:40.267641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:40.268057 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:40.297763 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c5e35caf-5596-4eed-ace1-8d9d35e1b758 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.209461 Aug 18 17:07:40.298360 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 144/303] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:07:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:07:40.404519 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:40.414124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-233ac6fd-533a-45b6-bac2-bea5d581c97e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1510 microversion: 2.1 time: 0.157891 Aug 18 17:07:40.414124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 160/304] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:40 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:41.278074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:41.279580 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:41.287267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:41.287267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:41.287617 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:41.288404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:41.289402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:41.289921 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:41.436446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:41.437186 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:41.444770 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:41.445357 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:41.445867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:41.446670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:41.447204 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:41.447736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:41.451343 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:41.452886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:41.459815 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:41.461240 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:41.462405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d625c05e-54d0-40eb-b45b-523d6ded6039 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.189184 Aug 18 17:07:41.462962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 145/305] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:41 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:07:41.601644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:41.610031 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-eefa18bf-d833-4793-97bb-dfb542c4a0b1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1510 microversion: 2.1 time: 0.179398 Aug 18 17:07:41.610593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 161/306] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:41 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1510 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:42.485853 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:42.486526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:42.493802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:42.496868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:42.496868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:42.496868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:42.496868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:42.497242 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:42.630938 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:42.632410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:42.639710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:42.642555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:42.642555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:42.642555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:42.642555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:42.643108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:42.655201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:42.664935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:42.671661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:42.671661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f7d249dd-8afb-42a4-b03e-d1b993edfa9d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.186526 Aug 18 17:07:42.671661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 146/307] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:42 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:42.821483 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:42.823031 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7f6637bb-901b-4248-9694-b357c9f94747 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1510 microversion: 2.1 time: 0.196760 Aug 18 17:07:42.823621 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 162/308] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:42 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1510 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:43.061271 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-883117664", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c53d22-e6a6-4bb0-95db-6f41b7bca33b"}], "security_groups": [{"name": "tempest-securitygroup--966241041"}], "key_name": "tempest-keypair-665410517", "user_data": "}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:43.169379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] validate_networks() for [('93c53d22-e6a6-4bb0-95db-6f41b7bca33b', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:07:43.559098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:07:43.561845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:07:43.561845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:07:43.561845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:07:43.561845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:07:43.569985 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:43.570478 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:43.570917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:43.571693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:43.572154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:43.572587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:43.590716 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for project 4eececcd804446e49078038ab362b235. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:07:43.594825 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for user 1fec6bdfe9ee4e839efaf7a1c083c31d and project 4eececcd804446e49078038ab362b235. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:07:43.605845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:07:43.608254 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:07:43.692640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:43.693249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:43.700803 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:43.701287 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:43.701722 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:43.702420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:43.702922 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:43.703290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:43.759041 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c8548048-10da-4dd1-a2ff-cb3166aec42f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.702499 Aug 18 17:07:43.759724 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 147/309] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:07:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:07:43.773187 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e4a464b2-4e2d-4f07-a2ea-d4e4d629beee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:43.774148 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e4a464b2-4e2d-4f07-a2ea-d4e4d629beee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:43.846898 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:43.868188 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:43.869690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:43.870865 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c0ba1b70-d89f-4388-a50f-70cbfa043f79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.182103 Aug 18 17:07:43.871746 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e4a464b2-4e2d-4f07-a2ea-d4e4d629beee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:43.872944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 163/310] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:43 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:43.896756 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e4a464b2-4e2d-4f07-a2ea-d4e4d629beee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1240 microversion: 2.1 time: 0.128283 Aug 18 17:07:43.897522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 148/311] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:43 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1240 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:43.905379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:43.906069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:43.935497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:43.935497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:43.935497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:43.935497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:43.936041 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:43.936041 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:44.124123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:44.135403 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-66e123c0-341c-4c74-994f-6a23a8197574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1510 microversion: 2.1 time: 0.255016 Aug 18 17:07:44.149336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 164/312] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:43 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:44.897599 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:44.898238 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:44.906457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:44.907024 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:44.907842 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:44.909123 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:44.909802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:44.910525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:44.930739 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:44.934936 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:44.944232 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:44.945773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:44.946519 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:44.947727 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:44.948440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:44.949139 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:45.135111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:45.154339 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:45.169963 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:45.171643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:45.172990 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7900a508-0927-4713-a039-85abe649a368 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.279801 Aug 18 17:07:45.177910 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8e46d578-570d-4177-bbb3-ca0068ed8d2b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1244 microversion: 2.1 time: 0.255568 Aug 18 17:07:45.178535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 165/313] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:44 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1244 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:45.195894 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 149/314] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:44 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:45.199359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:45.199359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:45.227988 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:45.231662 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:45.236059 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:45.239388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:45.240538 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:45.243090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:45.444071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:45.457526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-39bafd2b-34b7-4369-bf9a-fc84517d9e6d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1510 microversion: 2.1 time: 0.277914 Aug 18 17:07:45.458550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 166/315] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:45 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1510 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:46.203065 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:46.203749 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:46.210653 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:46.213647 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:46.214218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:46.214218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:46.214218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:46.214218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:46.214622 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:46.231364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:46.240344 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:46.241350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:46.241792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:46.249204 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:46.250046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:46.250687 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:46.333563 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:46.344124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-29931fa8-23b7-43d7-a349-d37d7899aa75 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1292 microversion: 2.1 time: 0.138889 Aug 18 17:07:46.345970 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 167/316] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:46 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1292 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:46.437610 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:46.448525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:46.451134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:46.452824 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-75004e1c-3d3d-4121-8a46-dd2d14c52489 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.256268 Aug 18 17:07:46.464314 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 150/317] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:46 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:46.517602 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:46.518327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:46.525605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:46.526450 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:46.527105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:46.528811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:46.529483 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:46.529981 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:46.745122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:46.754973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-db5c0c35-f148-4c7f-ad73-6ae27b299a6a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1516 microversion: 2.1 time: 0.241071 Aug 18 17:07:46.756072 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 168/318] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:46 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1516 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:47.372597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:47.374158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:47.388844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:47.389882 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:47.391644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:47.392925 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:47.403550 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:47.407371 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:47.477315 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:47.478785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:47.493100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:47.493595 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:47.494033 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:47.494753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:47.495206 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:47.495698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:47.548282 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:47.556384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-bca7cc22-96aa-49c1-b5e6-77b70c5e3d53 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1298 microversion: 2.1 time: 0.191604 Aug 18 17:07:47.556973 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 151/319] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:47 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1298 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:47.663906 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:47.690627 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:47.695180 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:47.697033 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-15ab41f2-9cdf-41c8-a351-006102e48bd0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.223708 Aug 18 17:07:47.697641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 169/320] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:47 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:07:48.469406 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a2af3941-54c8-4286-93a7-76c6b4476e16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'create', calling method: .version_select at 0x7ff5b573e700>, body: {"keypair": {"name": "tempest-keypair-352442099", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKgaHwaN0zpkYi0wF1xmdIsQ6ixJftc4RU89VEr3nkyubXWa8QQqTWZ0dQVwOps1bbxTXv3Z9GtM3761t9/TrYqT8ncatHLHLLAu1KMQfcgGvNKPAzcl3XGGWHRI0+zmTQ=="}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:48.488236 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-a2af3941-54c8-4286-93a7-76c6b4476e16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Getting quotas for project ccc5c89023ff476ca3b85680f56f8899. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:07:48.493101 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-a2af3941-54c8-4286-93a7-76c6b4476e16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Getting quotas for user a3bc033664c445f78b9d67440876c19d and project ccc5c89023ff476ca3b85680f56f8899. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:07:48.577950 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:48.579962 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:48.587278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:48.588134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:48.588710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:48.589731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:48.590273 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:48.590793 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:48.637380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a2af3941-54c8-4286-93a7-76c6b4476e16 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.171241 Aug 18 17:07:48.638124 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 152/321] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:07:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:07:48.725706 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:48.726378 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:48.748120 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:48.751573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:48.752271 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:48.757588 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:48.759766 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:48.759766 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:48.811400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:48.827535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2085ba79-484e-489d-b4b6-ab999970c22a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.253613 Aug 18 17:07:48.843210 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 170/322] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:48 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:49.063742 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:49.073108 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:49.075629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:49.077387 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-412add3d-1797-4e81-8d58-a1e06b80ca9b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.360407 Aug 18 17:07:49.078685 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 153/323] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:48 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:07:49.293185 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-e1aa0126-7500-4c1a-887c-0eae76af38bc req-35773cc6-336d-4a59-b81e-50a0980ba7f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de", "tag": "6ece756e-5432-4424-b12d-e1dd5eb8ec5a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:49.315179 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-e1aa0126-7500-4c1a-887c-0eae76af38bc req-35773cc6-336d-4a59-b81e-50a0980ba7f3 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:49.315695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-e1aa0126-7500-4c1a-887c-0eae76af38bc req-35773cc6-336d-4a59-b81e-50a0980ba7f3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:49.316320 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-e1aa0126-7500-4c1a-887c-0eae76af38bc req-35773cc6-336d-4a59-b81e-50a0980ba7f3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:49.338929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-e1aa0126-7500-4c1a-887c-0eae76af38bc req-35773cc6-336d-4a59-b81e-50a0980ba7f3 service nova] Creating event network-changed:6ece756e-5432-4424-b12d-e1dd5eb8ec5a for instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de on hv-cinder-85367 Aug 18 17:07:49.344968 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-e1aa0126-7500-4c1a-887c-0eae76af38bc req-35773cc6-336d-4a59-b81e-50a0980ba7f3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055639 Aug 18 17:07:49.346180 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 171/324] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:07:49.866119 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:49.868602 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:49.879210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:49.880452 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:49.881050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:49.882174 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:49.882817 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:49.883544 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:50.109754 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:50.113303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:50.137248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:50.138166 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:50.138904 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:50.140203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:50.141048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:50.141852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:50.223471 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:50.255643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-cc89fbfc-ec96-48c1-860b-db88845c4839 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.398510 Aug 18 17:07:50.256590 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 154/325] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:49 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:50.500502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:50.510592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:50.513352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:50.514918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fdb3783e-ca7c-448c-9d40-744d976a8621 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1744 microversion: 2.20 time: 0.414440 Aug 18 17:07:50.515764 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 172/326] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:50 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1744 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:07:51.289226 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:51.290567 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:51.298703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:51.299481 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:51.300108 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:51.301039 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:51.301647 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:51.302251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:51.513801 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:51.522554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9e36847f-c800-41e8-8f7b-3a46d9781263 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.238536 Aug 18 17:07:51.534865 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 155/327] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:51 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:51.540199 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:51.540883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:51.547611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:51.548097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:51.548760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:51.549940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:51.550552 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:51.551240 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:51.747135 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:51.756403 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:51.758067 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:51.759254 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-40a579a5-a7c7-4615-bbbb-cf07124fd32b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1744 microversion: 2.20 time: 0.223257 Aug 18 17:07:51.760153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 173/328] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:51 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:52.014076 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1964915360", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9262925b-65a7-4a9e-8370-bb0d87864ea7"}], "security_groups": [{"name": "tempest-securitygroup--1759361685"}], "key_name": "tempest-keypair-352442099", "user_data": "}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:52.547131 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:52.548696 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:52.559815 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:52.561139 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:52.562151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:52.563635 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:52.564221 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:52.564955 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:52.807182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:52.819958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-18726f25-7d76-4ced-87b6-3475281bd665 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.278382 Aug 18 17:07:52.832809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 174/329] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:52 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:52.832809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:52.832809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:52.838569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:52.840131 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:52.840494 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:52.841438 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:52.842376 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:52.843021 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:53.007163 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:53.016438 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:53.017964 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:53.019114 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f1da2f0a-8add-4700-83f6-ae359816ffe4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.196714 Aug 18 17:07:53.020508 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 175/330] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:52 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:53.025490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-b3798ce3-fdaf-4ab3-a81f-696d895e914a req-9fbba585-272d-4f80-8061-d33e8b486617 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e481aa-bf5a-436b-baca-f5c8b88de401", "name": "network-vif-plugged", "status": "completed", "tag": "9d480631-4b24-43e0-8000-c7d4668399bb"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:07:53.036485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-b3798ce3-fdaf-4ab3-a81f-696d895e914a req-9fbba585-272d-4f80-8061-d33e8b486617 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:53.037206 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-b3798ce3-fdaf-4ab3-a81f-696d895e914a req-9fbba585-272d-4f80-8061-d33e8b486617 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:53.037632 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-b3798ce3-fdaf-4ab3-a81f-696d895e914a req-9fbba585-272d-4f80-8061-d33e8b486617 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:53.053367 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-b3798ce3-fdaf-4ab3-a81f-696d895e914a req-9fbba585-272d-4f80-8061-d33e8b486617 service nova] Creating event network-vif-plugged:9d480631-4b24-43e0-8000-c7d4668399bb for instance 68e481aa-bf5a-436b-baca-f5c8b88de401 on hv-cinder-85367 Aug 18 17:07:53.060999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-b3798ce3-fdaf-4ab3-a81f-696d895e914a req-9fbba585-272d-4f80-8061-d33e8b486617 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037719 Aug 18 17:07:53.061873 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 176/331] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:07:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:07:53.579424 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:53.841118 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:53.841832 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:53.848680 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:53.849410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:53.849760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:53.850530 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:53.851065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:53.851607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:54.021822 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:54.031097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3ac8d03b-287c-4a75-878b-b43391ebd046 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.194127 Aug 18 17:07:54.031775 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 177/332] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:53 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:54.046772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:54.047485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:54.055492 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:54.056051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:54.056682 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:54.057405 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:54.058018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:54.059784 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:54.201087 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:54.211910 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:54.213801 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:54.216321 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b8b0222b-5a55-43ad-ac30-0c2046a65320 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.175967 Aug 18 17:07:54.217270 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 178/333] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:54 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:55.055086 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:55.055770 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:55.064843 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:55.065542 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:55.066129 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:55.070592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:55.071285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:55.071889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:55.079414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:55.214785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:55.222708 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5b63d236-6f8e-476b-a7fb-dc465275f96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.172142 Aug 18 17:07:55.223294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 179/334] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:55 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:55.240503 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:55.241114 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:55.247819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:55.248313 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:55.248745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:55.249459 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:55.249911 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:55.250334 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:55.401165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:55.410332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:55.411860 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:55.413033 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4c2e37d7-b33b-4f62-a123-16f040dc9785 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.176447 Aug 18 17:07:55.413588 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 180/335] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:55 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:56.244152 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:56.244866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:56.252418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:56.253134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:56.253794 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:56.254409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:56.254970 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:56.255592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:56.410130 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:56.421420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c877a093-d9b2-4bf3-9ada-9f885fe4b274 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.180915 Aug 18 17:07:56.423023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 181/336] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:56 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:56.437990 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:56.438872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:56.446057 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:56.446790 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:56.447227 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:56.447979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:56.448437 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:56.448871 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:56.586852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:56.596344 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:56.598023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:56.599301 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ac49d598-a04c-4a11-992f-e86e73559390 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.166407 Aug 18 17:07:56.599978 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 182/337] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:56 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:57.446752 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:57.447993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:57.452344 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:07:57.460537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:57.461479 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:57.462450 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:57.463740 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:57.465270 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:57.466277 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:57.713786 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:57.741061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-46ed7891-9aa2-4501-8e0a-2e3b21969897 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.299684 Aug 18 17:07:57.744260 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 183/338] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:57 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:07:57.763568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:57.766159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:57.788456 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] validate_networks() for [('9262925b-65a7-4a9e-8370-bb0d87864ea7', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:07:57.798197 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:57.799926 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:57.801857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:57.804990 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:57.807585 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:57.811726 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:58.130266 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:58.141172 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:58.144024 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:58.148404 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4c28bf02-48a4-46b8-a1fb-7a442fd11c29 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.400337 Aug 18 17:07:58.151972 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 184/339] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:57 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:58.360587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:07:58.360587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:07:58.360587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:07:58.360587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:07:58.360587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:07:58.384232 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:58.385506 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:58.387157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:58.388436 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:58.391751 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:58.391751 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:58.416445 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Getting quotas for project ccc5c89023ff476ca3b85680f56f8899. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:07:58.420857 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Getting quotas for user a3bc033664c445f78b9d67440876c19d and project ccc5c89023ff476ca3b85680f56f8899. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:07:58.432599 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:07:58.434814 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:07:58.606349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-afec72b0-4e5c-464d-9b72-558104268fa8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.596585 Aug 18 17:07:58.607011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 156/340] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:07:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 6598 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:07:58.617688 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-42dc014c-561b-4715-b2e6-19c57535a16f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:58.618302 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-42dc014c-561b-4715-b2e6-19c57535a16f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:58.735008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-42dc014c-561b-4715-b2e6-19c57535a16f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:58.736659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-42dc014c-561b-4715-b2e6-19c57535a16f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1245 microversion: 2.1 time: 0.122636 Aug 18 17:07:58.737246 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 185/341] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:58 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1245 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:58.793898 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:58.795737 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:58.809701 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:58.811348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:58.813470 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:58.825195 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:58.830616 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:58.838198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:59.096046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:59.107502 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e2a0d9db-7a01-4aa5-adb9-0ed234dca0e9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.331287 Aug 18 17:07:59.108734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 157/342] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:58 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:07:59.181538 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:59.182461 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:59.198314 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:59.200832 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:59.202699 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:59.204461 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:07:59.207153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:07:59.207725 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:07:59.443342 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:59.459040 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:59.461771 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:59.463418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1e6daabc-25f1-487e-aeec-7a55431e5596 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.286323 Aug 18 17:07:59.469960 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 186/343] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:07:59 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:07:59.759294 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-687742f8-fc92-4e2d-9eed-e55c85bd8c1a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:07:59.764251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-687742f8-fc92-4e2d-9eed-e55c85bd8c1a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:07:59.880833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-687742f8-fc92-4e2d-9eed-e55c85bd8c1a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:07:59.888171 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-687742f8-fc92-4e2d-9eed-e55c85bd8c1a tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1245 microversion: 2.1 time: 0.133197 Aug 18 17:07:59.888711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 158/344] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:07:59 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1245 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:08:00.131077 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:00.131811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:00.145550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:00.152909 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:00.155674 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:00.155928 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:00.157944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:00.158451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:00.456681 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:00.465822 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b2af0007-c2dd-4aed-86f2-8b905b939c2a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.339226 Aug 18 17:08:00.466739 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 187/345] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:00 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:08:00.500891 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:00.501648 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:00.503811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:00.523040 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:00.523567 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:00.525753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:00.526649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:00.527852 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:00.528442 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:00.865165 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:00.901323 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:00.903172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:00.904523 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-33c1fbe0-e5fa-4337-8310-96242cd3fe5d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.419047 Aug 18 17:08:00.905634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 159/346] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:00 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:00.925478 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:00.926336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:00.933143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:00.934423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:00.935022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:00.935929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:00.936816 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:00.937384 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:01.033501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:01.044586 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c9baf5b3-89ef-4b8e-ad45-cf89261a7574 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1297 microversion: 2.1 time: 0.122832 Aug 18 17:08:01.045505 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 188/347] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:00 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1297 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:01.488771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:01.490565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:01.518234 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:01.518737 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:01.519431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:01.528753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:01.529538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:01.533963 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:01.927970 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:01.929392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:01.934687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:01.945924 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:01.948139 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-46fe3bb9-56d8-40bc-b7ba-0944c1219dfa tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.461752 Aug 18 17:08:01.948303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:01.950480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:01.950712 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 160/348] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:01 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:01.969617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:01.970129 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:01.970574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:02.067846 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:02.068793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:02.081771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:02.085247 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:02.086053 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:02.087023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:02.088361 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:02.089713 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:02.335646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:02.347014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:02.350963 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:02.350963 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7d9a2318-9015-4c7a-8872-afa32d41b41c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.427013 Aug 18 17:08:02.364241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 189/349] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:01 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:02.618505 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:02.628489 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-735237fb-3ac9-4077-a0b1-20ec8a37fa4b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1303 microversion: 2.1 time: 0.566355 Aug 18 17:08:02.635337 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 161/350] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:02 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1303 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:02.979336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:02.981401 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:03.010991 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:03.020880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:03.020880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:03.020880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:03.020880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:03.022423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:03.386157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:03.387680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:03.399254 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:03.408373 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:03.415348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:03.417982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:03.418694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:03.419637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:03.539947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:03.562454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e274a3ff-e485-44ae-afb5-dbd81e017706 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.587283 Aug 18 17:08:03.575475 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 190/351] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:02 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:03.579132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-9d4e5fc8-523e-4126-8a06-0841e6ecce62 req-8f7db1f5-c20f-4c9b-9fc2-36e3b2074da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de", "name": "network-vif-plugged", "status": "completed", "tag": "6ece756e-5432-4424-b12d-e1dd5eb8ec5a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:03.614565 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9d4e5fc8-523e-4126-8a06-0841e6ecce62 req-8f7db1f5-c20f-4c9b-9fc2-36e3b2074da3 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:03.617473 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9d4e5fc8-523e-4126-8a06-0841e6ecce62 req-8f7db1f5-c20f-4c9b-9fc2-36e3b2074da3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:03.617866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-9d4e5fc8-523e-4126-8a06-0841e6ecce62 req-8f7db1f5-c20f-4c9b-9fc2-36e3b2074da3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:03.647947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-9d4e5fc8-523e-4126-8a06-0841e6ecce62 req-8f7db1f5-c20f-4c9b-9fc2-36e3b2074da3 service nova] Creating event network-vif-plugged:6ece756e-5432-4424-b12d-e1dd5eb8ec5a for instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de on hv-cinder-85367 Aug 18 17:08:03.659247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-9d4e5fc8-523e-4126-8a06-0841e6ecce62 req-8f7db1f5-c20f-4c9b-9fc2-36e3b2074da3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092437 Aug 18 17:08:03.663343 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 191/352] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:08:03.684087 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:03.685316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:03.692883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:03.693296 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:03.693733 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:03.694442 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:03.695243 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:03.695375 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:03.944591 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:03.962842 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:03.966804 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cb152bea-f09b-4fcd-87be-00e8bfaf63a2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.290333 Aug 18 17:08:03.971947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 192/353] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:03 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:03.983002 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:04.004970 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:04.015373 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-79eb2171-0728-40a1-ab90-2e9ad622861b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.633137 Aug 18 17:08:04.016914 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 162/354] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:03 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:04.586925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:04.587719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:04.598035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:04.598542 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:04.598984 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:04.599820 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:04.600282 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:04.600704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:04.783484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:04.797198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fa8b548c-4a06-4a7a-ac03-447476f221eb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.207252 Aug 18 17:08:04.797198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 193/355] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:04 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:08:04.996695 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:04.998856 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:05.028537 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:05.030454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:05.032740 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:05.036742 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:05.041777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:05.042570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:05.046022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:05.046679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:05.057744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:05.058270 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:05.058718 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:05.059445 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:05.059925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:05.060342 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:05.367965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:05.378292 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:05.380838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:05.385231 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7e9ba3ba-62b7-4155-8ef9-26f0f3e4a3f8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.343785 Aug 18 17:08:05.386943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 194/356] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:05 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:05.403458 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:05.412138 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e1f598c2-8256-4fb5-a54e-85c96df53c07 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.422486 Aug 18 17:08:05.413048 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 163/357] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:04 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:05.528070 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-1a4145ed-9f92-402e-a78a-198d29d1b364 req-2c358675-b11f-4d29-a0c6-4326e4d0747f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ee2546-05c3-461e-bbc0-64cb39d936f7", "tag": "4be84b1f-a309-40e8-8519-3e746d6a87a8"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:05.559184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1a4145ed-9f92-402e-a78a-198d29d1b364 req-2c358675-b11f-4d29-a0c6-4326e4d0747f service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:05.559962 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1a4145ed-9f92-402e-a78a-198d29d1b364 req-2c358675-b11f-4d29-a0c6-4326e4d0747f service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:05.562536 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1a4145ed-9f92-402e-a78a-198d29d1b364 req-2c358675-b11f-4d29-a0c6-4326e4d0747f service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:05.603187 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-1a4145ed-9f92-402e-a78a-198d29d1b364 req-2c358675-b11f-4d29-a0c6-4326e4d0747f service nova] Creating event network-changed:4be84b1f-a309-40e8-8519-3e746d6a87a8 for instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 on hv-cinder-85367 Aug 18 17:08:05.613950 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-1a4145ed-9f92-402e-a78a-198d29d1b364 req-2c358675-b11f-4d29-a0c6-4326e4d0747f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090939 Aug 18 17:08:05.630769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 195/358] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:08:05.810884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:05.811803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:05.832989 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:05.833789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:05.834403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:05.835297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:05.835949 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:05.836546 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:06.081612 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:06.094039 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-abf1d247-0b25-4360-90de-0ba005361d1e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1365 microversion: 2.1 time: 0.287046 Aug 18 17:08:06.096270 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 164/359] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:05 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:06.413134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:06.414257 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:06.434523 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:06.436143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:06.437200 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:06.438006 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:06.441605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:06.443213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:06.447948 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:06.449454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:06.461542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:06.462603 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:06.471857 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:06.473144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:06.476771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:06.477506 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:06.497721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=100 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:06.824944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:06.836038 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:06.838710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:06.840517 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6a19bb3a-c24d-4ea8-9abd-8cadf52e0bad tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.431640 Aug 18 17:08:06.841768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 196/360] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:06 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:07.051772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:07.060778 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-706fed44-a6cd-4970-801b-1020a6192ed3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.631533 Aug 18 17:08:07.064543 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 165/361] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:06 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:07.117123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:07.117977 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:07.130199 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:07.131737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:07.132353 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:07.137284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:07.137704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:07.138154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:07.426093 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:07.434278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4706bf27-b9e1-4ff4-a12d-5e3145389a69 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1555 microversion: 2.1 time: 0.321261 Aug 18 17:08:07.434855 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 197/362] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:07 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1555 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:07.460228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e885dbae-0d66-4e10-8532-cf9662f3c5de tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:07.461620 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e885dbae-0d66-4e10-8532-cf9662f3c5de tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:07.475969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e885dbae-0d66-4e10-8532-cf9662f3c5de tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:07.476495 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e885dbae-0d66-4e10-8532-cf9662f3c5de tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:07.477012 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e885dbae-0d66-4e10-8532-cf9662f3c5de tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:07.477764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e885dbae-0d66-4e10-8532-cf9662f3c5de tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:07.479869 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e885dbae-0d66-4e10-8532-cf9662f3c5de tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:07.480334 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e885dbae-0d66-4e10-8532-cf9662f3c5de tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:07.868874 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:07.871590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:07.889060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:07.891380 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:07.893663 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:07.894686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:07.895169 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:07.898673 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:07.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:08.155145 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e885dbae-0d66-4e10-8532-cf9662f3c5de tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.698810 Aug 18 17:08:08.164604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 166/363] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Aug 18 17:08:07 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de/os-interface => generated 284 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:08:08.183690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:08.189119 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:08.204288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:08.205546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:08.212275 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:08.226805 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-91508f70-3776-448c-b6d8-dd8354b1d413 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.359671 Aug 18 17:08:08.248687 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 198/364] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:07 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:08.254693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:08.259696 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:08.261679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:08.262675 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:08.265656 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:08.266314 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:08.405298 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:08.752142 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:08.774312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9e20e31a-c9d9-4246-a8e8-81a9446fb6ed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.607006 Aug 18 17:08:08.775224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 167/365] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:08 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:09.265298 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:09.266572 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:09.268758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:09.283280 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:09.284050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:09.285654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:09.290515 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:09.291226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:09.291856 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:09.521926 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:09.530192 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:09.531734 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:09.533040 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9e469cdf-c4f5-44f7-976d-67332ebf7061 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.272988 Aug 18 17:08:09.533684 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 199/366] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:09 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:09.796814 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:09.797423 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:09.815795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:09.816781 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:09.817223 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:09.817939 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:09.818421 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:09.818841 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:09.887956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=28 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:10.069097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:10.079262 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2e8b7fa5-c01f-4c1c-ab1f-ea497b858fee tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.286995 Aug 18 17:08:10.080081 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 168/367] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:09 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:10.246349 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-5fd9b4cb-35ca-4149-9d24-e80faba65ed2 req-cfeceac4-44fd-45bc-9bce-de05eecf2f12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de", "tag": "6ece756e-5432-4424-b12d-e1dd5eb8ec5a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:10.255865 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5fd9b4cb-35ca-4149-9d24-e80faba65ed2 req-cfeceac4-44fd-45bc-9bce-de05eecf2f12 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:10.258929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5fd9b4cb-35ca-4149-9d24-e80faba65ed2 req-cfeceac4-44fd-45bc-9bce-de05eecf2f12 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:10.258929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5fd9b4cb-35ca-4149-9d24-e80faba65ed2 req-cfeceac4-44fd-45bc-9bce-de05eecf2f12 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:10.267670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-5fd9b4cb-35ca-4149-9d24-e80faba65ed2 req-cfeceac4-44fd-45bc-9bce-de05eecf2f12 service nova] Creating event network-changed:6ece756e-5432-4424-b12d-e1dd5eb8ec5a for instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de on hv-cinder-85367 Aug 18 17:08:10.272768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-5fd9b4cb-35ca-4149-9d24-e80faba65ed2 req-cfeceac4-44fd-45bc-9bce-de05eecf2f12 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030241 Aug 18 17:08:10.273385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 200/368] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:08:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:08:10.558298 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:10.559493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:10.575590 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:10.581145 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:10.590749 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:10.593142 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:10.595182 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:10.595859 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:10.917996 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:10.937224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:10.943625 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:10.945051 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-08028398-d488-4907-8f2d-8a00d10fc6b2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.391968 Aug 18 17:08:10.962861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 169/369] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:10 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:11.101033 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:11.103118 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:11.126778 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:11.129216 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:11.133884 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:11.136283 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:11.136769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:11.137210 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:11.418581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:11.430188 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-adc8a1b7-6b58-4e35-ac5c-6c81a484b06c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.329993 Aug 18 17:08:11.431046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 201/370] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:11 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:11.974165 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:11.975328 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:11.988782 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:11.991948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:11.994136 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:11.996395 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:11.997258 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:11.997694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:12.255469 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:12.272341 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:12.281159 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:12.285041 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-cb047c9c-9935-4fbf-ba98-8b28a6b9bd4c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.314652 Aug 18 17:08:12.286694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 170/371] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:11 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:12.453126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:12.455554 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:12.463133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:12.463774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:12.465866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:12.466780 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:12.467379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:12.467982 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:12.653622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:12.662046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d07d0436-a62c-4efb-ab25-de8fd016a04b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.212856 Aug 18 17:08:12.662620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 202/372] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:12 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:13.310046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:13.311964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:13.320133 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:13.320929 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:13.321857 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:13.323016 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:13.324307 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:13.324958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:13.497777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:13.506328 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:13.509271 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:13.512255 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a4fafff0-1e37-4de2-92b8-08bc00f3fcd8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.206229 Aug 18 17:08:13.521800 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 171/373] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:13 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:13.685458 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:13.686072 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:13.692867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:13.693354 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:13.693789 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:13.694497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:13.694945 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:13.695363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:13.839850 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:13.849639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-93a8f938-95a2-45e4-a51b-606853311c96 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.168278 Aug 18 17:08:13.850871 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 203/374] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:13 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:14.539404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:14.540131 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:14.547725 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:14.549872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:14.549872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:14.549872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:14.549872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:14.550320 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:14.732163 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:14.744698 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:14.748268 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:14.749497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-baedc7b8-37a1-4509-a3f7-511fbac027f5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.216321 Aug 18 17:08:14.750270 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 172/375] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:14 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:14.875277 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:14.875930 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:14.891278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:14.891278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:14.891278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:14.891278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:14.891813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:14.891813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:15.061349 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:15.066158 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bf94b945-08dc-4d59-a42a-dd0193acef8e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.194697 Aug 18 17:08:15.066736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 204/376] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:14 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:15.778639 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:15.779370 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:15.786417 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:15.786916 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:15.787360 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:15.788573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:15.788672 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:15.789195 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:15.933931 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:15.942135 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:15.943656 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:15.944858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ed3202c0-dd1b-4580-9107-c9017d7ba930 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1739 microversion: 2.20 time: 0.171060 Aug 18 17:08:15.945418 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 173/377] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:15 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:16.087200 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:16.087994 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:16.105936 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:16.106477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:16.106920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:16.107670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:16.108309 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:16.108775 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:16.260300 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:16.268732 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-635230ae-b971-4005-93df-e550abc23e58 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.185328 Aug 18 17:08:16.271124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 205/378] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:16 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:16.967636 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:16.968412 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:16.974936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:16.975454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:16.975972 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:16.976668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:16.977130 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:16.977556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:17.130684 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:17.139100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:17.140654 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:17.141828 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-28b60255-f014-408a-98e9-c187cab3e570 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1721 microversion: 2.20 time: 0.178176 Aug 18 17:08:17.142593 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 174/379] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:16 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:17.294373 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:17.295768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:17.303879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:17.309085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:17.309085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:17.309085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:17.309085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:17.310011 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:17.447227 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:17.455984 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7924e268-eb5e-49ac-a18c-57b6dd4a671f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.166568 Aug 18 17:08:17.456857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 206/380] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:17 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:18.165486 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:18.166132 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:18.173182 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:18.173674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:18.174118 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:18.174825 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:18.175287 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:18.175741 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:18.351968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:18.360592 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:18.362256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:18.363525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2d18ac7d-c6c0-4c87-a6c3-67cfb5dad2d5 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1721 microversion: 2.20 time: 0.202161 Aug 18 17:08:18.364091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 175/381] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:18 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:18.489972 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:18.490585 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:18.497184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:18.497929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:18.498363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:18.499137 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:18.499624 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:18.500049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:18.709199 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:18.716951 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ee03c083-9d2c-44f8-bf13-f362fa1694ae tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.231522 Aug 18 17:08:18.717598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 207/382] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:18 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:19.067019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-057793aa-e163-47e9-b58b-f63dfcba0c73 req-b0bc1db7-7d3e-4167-b2e0-85949089ceee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ee2546-05c3-461e-bbc0-64cb39d936f7", "name": "network-vif-plugged", "status": "completed", "tag": "4be84b1f-a309-40e8-8519-3e746d6a87a8"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:19.081582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-057793aa-e163-47e9-b58b-f63dfcba0c73 req-b0bc1db7-7d3e-4167-b2e0-85949089ceee service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:19.082394 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-057793aa-e163-47e9-b58b-f63dfcba0c73 req-b0bc1db7-7d3e-4167-b2e0-85949089ceee service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:19.083149 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-057793aa-e163-47e9-b58b-f63dfcba0c73 req-b0bc1db7-7d3e-4167-b2e0-85949089ceee service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:19.101863 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-057793aa-e163-47e9-b58b-f63dfcba0c73 req-b0bc1db7-7d3e-4167-b2e0-85949089ceee service nova] Creating event network-vif-plugged:4be84b1f-a309-40e8-8519-3e746d6a87a8 for instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 on hv-cinder-85367 Aug 18 17:08:19.108130 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-057793aa-e163-47e9-b58b-f63dfcba0c73 req-b0bc1db7-7d3e-4167-b2e0-85949089ceee service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046100 Aug 18 17:08:19.108746 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 176/383] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:08:19.386306 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:19.387070 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:19.393555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:19.394303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:19.394730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:19.395524 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:19.395901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:19.396599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:19.602149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:19.613258 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:19.614675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:19.615879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cdafcd1b-a423-4efb-bf75-1a188bb70ea2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1721 microversion: 2.20 time: 0.233605 Aug 18 17:08:19.617032 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 208/384] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:19 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1721 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:19.754036 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:19.756392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:19.763281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1118841671", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1795979929", "security_groups": [{"name": "tempest-secgroup-smoke-14484777"}], "networks": [{"uuid": "dfa3d9c8-18ff-4cd0-b5f8-a8940caf13a1"}], "block_device_mapping_v2": [{"uuid": "94708cdc-c1e7-4b3d-b94b-c9cf199bcdb2", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:19.763422 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:19.763839 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:19.764317 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:19.764956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:19.765410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:19.765831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:19.948314 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.network.neutron [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] validate_networks() for [('dfa3d9c8-18ff-4cd0-b5f8-a8940caf13a1', None, None, None, None, None)] {{(pid=121267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:08:20.256723 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:20.265924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-45410070-3d40-4ef4-ace2-1462586ee5a6 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.530287 Aug 18 17:08:20.266866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 177/385] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:19 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:20.478822 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Flavor limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:08:20.479273 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Image limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:08:20.479833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Flavor pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:08:20.480870 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Image pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:08:20.482200 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:08:20.492387 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:20.492870 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:20.493489 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:20.494217 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:20.494673 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:20.495106 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:20.514119 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Getting quotas for project e5d8cae49e524a98ae646381b455351e. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:08:20.518635 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Getting quotas for user 99010fd86e3b4bf59fc39716d208f06f and project e5d8cae49e524a98ae646381b455351e. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:08:20.583968 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Going to run 1 instances... {{(pid=121267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:08:20.585863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='94708cdc-c1e7-4b3d-b94b-c9cf199bcdb2',volume_size=None,volume_type=None)] {{(pid=121267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:08:20.640693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:20.642037 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:20.648506 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:20.648992 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:20.649429 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:20.650137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:20.650595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:20.651027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:20.843643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:20.853978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:20.855035 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:20.856280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-aed880d9-5c07-4b11-8b74-4a9b529ebd2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1664 microversion: 2.20 time: 0.219780 Aug 18 17:08:20.856833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 178/386] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:20 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1664 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:20.884495 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a9bc767c-0d87-4501-92a4-2c6aa47bec21 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "486425b0-aa75-4c8c-a429-1ebe6f1ecbb4"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:20.887409 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a9bc767c-0d87-4501-92a4-2c6aa47bec21 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:20.893908 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a9bc767c-0d87-4501-92a4-2c6aa47bec21 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:20.894282 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a9bc767c-0d87-4501-92a4-2c6aa47bec21 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:20.894703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a9bc767c-0d87-4501-92a4-2c6aa47bec21 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:20.895454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a9bc767c-0d87-4501-92a4-2c6aa47bec21 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:20.896036 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a9bc767c-0d87-4501-92a4-2c6aa47bec21 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:20.896610 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a9bc767c-0d87-4501-92a4-2c6aa47bec21 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:21.027245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-41bcba07-622a-44d2-98e3-c58a4859df9a tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.269302 Aug 18 17:08:21.028585 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 209/387] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:08:19 2022] POST /compute/v2.1/servers => generated 404 bytes in 1271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:08:21.040999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-96224e32-686e-4cba-9c5b-996e65bbc954 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:21.041702 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-96224e32-686e-4cba-9c5b-996e65bbc954 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:21.211804 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-96224e32-686e-4cba-9c5b-996e65bbc954 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:21.219355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-96224e32-686e-4cba-9c5b-996e65bbc954 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1089 microversion: 2.1 time: 0.182416 Aug 18 17:08:21.220183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 210/388] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:21 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1089 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:08:21.225242 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-2acfd4a3-de5a-4eec-92b8-b70c29756975 req-3430b3b5-f980-4659-8456-77b60f818fea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e481aa-bf5a-436b-baca-f5c8b88de401", "name": "network-vif-unplugged", "status": "completed", "tag": "9d480631-4b24-43e0-8000-c7d4668399bb"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:21.235877 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-2acfd4a3-de5a-4eec-92b8-b70c29756975 req-3430b3b5-f980-4659-8456-77b60f818fea service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:21.236506 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-2acfd4a3-de5a-4eec-92b8-b70c29756975 req-3430b3b5-f980-4659-8456-77b60f818fea service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:21.237090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-2acfd4a3-de5a-4eec-92b8-b70c29756975 req-3430b3b5-f980-4659-8456-77b60f818fea service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:21.249491 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.compute.server_external_events [req-2acfd4a3-de5a-4eec-92b8-b70c29756975 req-3430b3b5-f980-4659-8456-77b60f818fea service nova] Unable to find a host for instance 68e481aa-bf5a-436b-baca-f5c8b88de401. Dropping event network-vif-unplugged {{(pid=121267) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 17:08:21.250638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-2acfd4a3-de5a-4eec-92b8-b70c29756975 req-3430b3b5-f980-4659-8456-77b60f818fea service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029075 Aug 18 17:08:21.251427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 211/389] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:08:21 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 30 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Aug 18 17:08:21.288140 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:21.288802 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:21.294954 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:21.296049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:21.296049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:21.296760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:21.297382 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:21.297965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:21.505340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:21.514310 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9a4379cb-ee34-4976-a4dd-0bfb861e594f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1371 microversion: 2.1 time: 0.230153 Aug 18 17:08:21.515024 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 212/390] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:21 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1371 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:08:22.180987 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a9bc767c-0d87-4501-92a4-2c6aa47bec21 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.300783 Aug 18 17:08:22.182419 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 179/391] 10.222.0.78 () {62 vars in 1364 bytes} [Thu Aug 18 17:08:20 2022] POST /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments => generated 188 bytes in 1303 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 17:08:22.239607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c31c0e7e-0b37-4f11-abc1-8b105fc98604 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:22.240322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c31c0e7e-0b37-4f11-abc1-8b105fc98604 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:22.330705 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:22.332005 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:22.336529 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c31c0e7e-0b37-4f11-abc1-8b105fc98604 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:22.343789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:22.344641 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:22.345397 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:22.346483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:22.347159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c31c0e7e-0b37-4f11-abc1-8b105fc98604 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1089 microversion: 2.1 time: 0.110695 Aug 18 17:08:22.347554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:22.355535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 213/392] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:22 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1089 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:22.356740 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:22.366850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:22.422143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121268) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 17:08:22.540416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:22.541477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:22.548567 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:22.556151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:22.556151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:22.556151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:22.556151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:22.557045 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:22.740860 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-81bd5ad6-38c2-4e72-8ff4-1f4233f71a36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/action" status: 202 len: 0 microversion: 2.20 time: 0.411195 Aug 18 17:08:22.740860 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 180/393] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Aug 18 17:08:22 2022] POST /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/action => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 17:08:22.747841 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:22.751970 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:22.765060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:22.772501 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:22.772992 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:22.773443 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:22.774136 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:22.774588 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:22.775012 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:22.786731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-81e68154-3bfe-4093-a25b-aaeed7218f1b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1566 microversion: 2.1 time: 0.254505 Aug 18 17:08:22.787566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 214/394] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:22 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:08:22.807013 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e5a83c2a-902d-43fc-a523-dd2d5628fd3f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:22.807535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e5a83c2a-902d-43fc-a523-dd2d5628fd3f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:22.823933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e5a83c2a-902d-43fc-a523-dd2d5628fd3f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:22.825540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e5a83c2a-902d-43fc-a523-dd2d5628fd3f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:22.826241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e5a83c2a-902d-43fc-a523-dd2d5628fd3f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:22.827183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e5a83c2a-902d-43fc-a523-dd2d5628fd3f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:22.827879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e5a83c2a-902d-43fc-a523-dd2d5628fd3f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:22.828461 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e5a83c2a-902d-43fc-a523-dd2d5628fd3f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:22.982423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e5a83c2a-902d-43fc-a523-dd2d5628fd3f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.178936 Aug 18 17:08:22.993846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 215/395] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Aug 18 17:08:22 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-interface => generated 285 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:08:23.282977 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:23.313761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:23.316125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:23.317709 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-08b2eafc-5fcd-4e2d-bc5c-5032ee476a6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1750 microversion: 2.20 time: 0.574554 Aug 18 17:08:23.318756 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 181/396] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:22 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1750 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:23.370196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:23.371546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:23.382838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:23.385941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:23.386619 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:23.388272 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:23.388786 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:23.389223 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:23.578733 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:23.581907 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-52d33125-5466-4b1c-abaa-879c05b19dd7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1131 microversion: 2.1 time: 0.217020 Aug 18 17:08:23.583714 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 216/397] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:23 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1131 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:24.342670 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:24.343893 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:24.361430 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:24.361981 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:24.362433 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:24.363173 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:24.363670 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:24.379939 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:24.612014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:24.612014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:24.632598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:24.633497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:24.635701 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:24.649239 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:24.651388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:24.652124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:24.805769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:24.823304 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4811f351-ef72-4281-951e-06e10c1aea0d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1205 microversion: 2.1 time: 0.221573 Aug 18 17:08:24.824686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 217/398] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:24 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1205 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:24.882633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-5479ff10-7b50-4c79-bad0-0c7b81002c69 req-1761945a-d883-43e7-8a3a-c58df7083df0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ee2546-05c3-461e-bbc0-64cb39d936f7", "tag": "4be84b1f-a309-40e8-8519-3e746d6a87a8"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:24.892878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5479ff10-7b50-4c79-bad0-0c7b81002c69 req-1761945a-d883-43e7-8a3a-c58df7083df0 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:24.893920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5479ff10-7b50-4c79-bad0-0c7b81002c69 req-1761945a-d883-43e7-8a3a-c58df7083df0 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:24.894558 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5479ff10-7b50-4c79-bad0-0c7b81002c69 req-1761945a-d883-43e7-8a3a-c58df7083df0 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:24.906428 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-5479ff10-7b50-4c79-bad0-0c7b81002c69 req-1761945a-d883-43e7-8a3a-c58df7083df0 service nova] Creating event network-changed:4be84b1f-a309-40e8-8519-3e746d6a87a8 for instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 on hv-cinder-85367 Aug 18 17:08:24.912096 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-5479ff10-7b50-4c79-bad0-0c7b81002c69 req-1761945a-d883-43e7-8a3a-c58df7083df0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033512 Aug 18 17:08:24.912672 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 218/399] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:08:24.933912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:24.953323 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:24.953323 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:24.953323 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a1232846-ef61-40fe-8d6a-e9830418ec03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1750 microversion: 2.20 time: 0.614330 Aug 18 17:08:24.953656 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 182/400] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:24 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1750 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:25.846035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:25.846737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:25.857775 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:25.858433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:25.859071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:25.859943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:25.860499 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:25.861027 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:25.952395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:25.959807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:25.965001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-08a3b511-24ad-4003-aec7-026f2b0ca5b5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1205 microversion: 2.1 time: 0.122950 Aug 18 17:08:25.966550 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 219/401] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:25 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1205 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:25.977400 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:25.978021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:25.994996 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:25.995539 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:25.996275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:25.997495 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:26.000692 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:26.002510 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:26.436694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:26.453468 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:26.455744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:26.459064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-dd74cb15-7f07-4282-9475-534270f758d3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1752 microversion: 2.20 time: 0.485809 Aug 18 17:08:26.460326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 183/402] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:25 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1752 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:26.995414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:27.000053 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:27.009298 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:27.011151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:27.012126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:27.014904 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:27.018431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:27.020845 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:27.354142 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:27.366348 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a30b47d8-5fcf-436c-912b-5e0aa03a656e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.376995 Aug 18 17:08:27.370932 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 220/403] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:26 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:27.484796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:27.485528 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:27.495377 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:27.497325 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:27.497977 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:27.498924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:27.499635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:27.500639 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:27.799265 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:27.828343 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:27.831421 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:27.833573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-973c95d7-e865-4cc6-8a78-7415ae00f4b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1752 microversion: 2.20 time: 0.355159 Aug 18 17:08:27.834153 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 184/404] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:27 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1752 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:28.158277 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-1b28377d-b08b-4825-8b7e-bab8c6e4f7dd req-a6e560c0-3308-4163-9194-011ba3e70e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1", "tag": "60e0cf05-5e8f-4133-8579-da77a04a4d8a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:28.164916 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:28.172941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1b28377d-b08b-4825-8b7e-bab8c6e4f7dd req-a6e560c0-3308-4163-9194-011ba3e70e07 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:28.184234 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1b28377d-b08b-4825-8b7e-bab8c6e4f7dd req-a6e560c0-3308-4163-9194-011ba3e70e07 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:28.184933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1b28377d-b08b-4825-8b7e-bab8c6e4f7dd req-a6e560c0-3308-4163-9194-011ba3e70e07 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:28.202185 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-1b28377d-b08b-4825-8b7e-bab8c6e4f7dd req-a6e560c0-3308-4163-9194-011ba3e70e07 service nova] Creating event network-changed:60e0cf05-5e8f-4133-8579-da77a04a4d8a for instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 on hv-cinder-85367 Aug 18 17:08:28.217776 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-1b28377d-b08b-4825-8b7e-bab8c6e4f7dd req-a6e560c0-3308-4163-9194-011ba3e70e07 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063836 Aug 18 17:08:28.219571 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 221/405] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:08:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:08:28.403806 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:28.406251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:28.415294 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:28.416293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:28.419305 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:28.420289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:28.421095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:28.421687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:28.859739 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:28.860722 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:28.900803 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:28.901350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:28.904731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:28.905500 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:28.905971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:28.906409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:29.006381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:29.025647 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ae0ec4a4-3505-4d8c-b737-45233296c002 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.625878 Aug 18 17:08:29.026698 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 185/406] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:28 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:29.203210 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:29.218401 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:29.220174 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:29.226969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c0fbac23-7f63-473c-92d2-f2adcaed9a77 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.373775 Aug 18 17:08:29.244544 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 222/407] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:28 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:30.052064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:30.052693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:30.060452 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:30.062918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:30.062918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:30.062918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:30.062918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:30.063600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:30.232284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:30.240836 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-65544b8a-e5eb-4376-95cf-826f2abfc673 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.193672 Aug 18 17:08:30.241416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 186/408] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:30 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:30.250665 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:30.251278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:30.257817 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:30.258331 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:30.258997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:30.259877 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:30.260494 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:30.261102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:30.435012 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:30.444725 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:30.446283 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:30.458633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-62bd9787-05b7-493c-8735-4bdf6c011c51 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.201855 Aug 18 17:08:30.458633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 223/409] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:30 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:31.268294 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:31.269387 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:31.281690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:31.283337 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:31.286379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:31.286949 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:31.287966 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:31.290553 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:31.291126 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:31.474263 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:31.476624 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:31.481335 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:31.488451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:31.489244 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:31.492896 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:31.492896 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:31.492896 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:31.492896 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:31.541100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:31.568859 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d2b66c1a-c660-4d0d-9dbf-98cec6738540 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.302517 Aug 18 17:08:31.577812 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 187/410] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:31 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:31.836906 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:31.848112 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:31.849915 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:31.851589 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-419296f3-4d13-4c62-977f-d09e796d4cff tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.381353 Aug 18 17:08:31.852676 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 224/411] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:31 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:32.603060 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:32.604519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:32.623655 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:32.624370 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:32.624976 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:32.625878 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:32.626726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:32.627310 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:32.874477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=10 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:32.879340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:32.880369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:32.888238 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:32.894442 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:32.894884 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:32.895804 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:32.896417 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:32.896940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:33.020588 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:33.038932 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e5c4e861-fa7d-45a9-aafe-ac55dcba066d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.440503 Aug 18 17:08:33.056013 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 188/412] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:32 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:33.296111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:33.312117 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:33.314269 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:33.315831 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-06f130e0-d52f-40f8-9ff9-0086eb17b9b6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.442030 Aug 18 17:08:33.318352 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 225/413] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:32 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:34.080918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:34.081513 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:34.092046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:34.092543 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:34.092981 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:34.093696 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:34.094160 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:34.094583 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:34.343047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:34.343883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:34.360475 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:34.362316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:34.363425 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:34.365663 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:34.368072 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:34.368771 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:34.443300 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:34.451605 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b06654e9-e774-4f49-800a-d3e511397d92 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.374873 Aug 18 17:08:34.468807 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 189/414] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:34 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:34.742322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:34.758184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:34.762427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:34.763691 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b1c3e440-fe43-4173-ad85-f48f3c6e73b0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.427476 Aug 18 17:08:34.788359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 226/415] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:34 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:35.476324 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:35.476959 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:35.486844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:35.487831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:35.488187 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:35.489089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:35.489555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:35.489989 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:35.788957 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:35.789589 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:35.797261 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:35.797759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:35.798278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:35.800657 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:35.801213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:35.801845 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:35.835359 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:35.844095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-bca382cf-7ab0-4846-9336-5a19bfac5b5e tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.371788 Aug 18 17:08:35.852102 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 190/416] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:35 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:35.982912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:35.993982 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:35.998448 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:35.998448 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4c1b03e9-d0c9-40ad-b7aa-8d85df78ba02 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.213201 Aug 18 17:08:35.998448 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 227/417] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:35 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:36.865962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:36.867183 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:36.874475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:36.874968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:36.875407 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:36.876133 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:36.876755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:36.877343 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:37.023096 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:37.032022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:37.032022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:37.032022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:37.032022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:37.032672 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:37.033635 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:37.034047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:37.055854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:37.072023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-65d6b372-71ff-4ee3-afcb-db6f1bdd2fb3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.209746 Aug 18 17:08:37.072842 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 191/418] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:36 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:37.187996 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:37.198909 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:37.200512 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:37.202075 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b41c5771-9afb-4d02-bcd1-024f32e55c6c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.183402 Aug 18 17:08:37.202755 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 228/419] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:37 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:38.093289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:38.093903 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:38.101233 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:38.101752 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:38.102364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:38.103059 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:38.103762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:38.104520 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:38.224906 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:38.225530 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:38.233097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:38.239655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:38.239655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:38.239655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:38.239655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:38.240072 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:38.355124 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:38.394739 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5e0dc5f6-fa87-4bf9-aaa9-899a70bff70b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.304844 Aug 18 17:08:38.418285 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 192/420] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:38 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:38.503589 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:38.521105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:38.538741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:38.538741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0b8419a0-2675-44f9-a63b-80bc39b9395e tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.304383 Aug 18 17:08:38.538741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 229/421] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:38 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:39.418267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:39.422027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:39.439621 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:39.440419 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:39.441245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:39.442168 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:39.442808 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:39.443415 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:39.554541 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:39.555158 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:39.570103 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:39.571340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:39.571995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:39.572819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:39.573415 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:39.573938 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:39.816298 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:39.830993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:39.839859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:39.839859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ce774125-fe81-438c-b459-e6c88ba3860c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.283982 Aug 18 17:08:39.843767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 230/422] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:39 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:08:39.975879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:39.988112 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2cdeeddd-a21f-416e-83fd-4f5a95712afe tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.573673 Aug 18 17:08:40.001581 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 193/423] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:39 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:40.861939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:40.862569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:40.869905 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:40.871196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:40.871792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:40.873073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:40.873642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:40.874232 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:41.010797 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:41.013146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:41.025876 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:41.032887 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:41.033744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:41.036893 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:41.042836 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:41.043561 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:41.239819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:41.255056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:41.260658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:41.265329 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bf6bcde1-acb5-4002-95dd-88ebdd3d2966 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.411091 Aug 18 17:08:41.267844 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 231/424] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:40 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:41.407393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:41.420907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-27f03ca6-3e39-493d-9466-81bf992ffde8 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.415196 Aug 18 17:08:41.421861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 194/425] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:41 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:42.295374 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:42.297543 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:42.335501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:42.341363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:42.342619 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:42.346327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:42.350168 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:42.351261 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:42.451841 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:42.452683 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:42.471019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:42.471768 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:42.473919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:42.475696 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:42.483692 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:42.487164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:42.637074 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:42.647485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:42.655048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:42.658680 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b23f8ed7-baab-4a5e-af31-09323f28b2df tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.372986 Aug 18 17:08:42.659289 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 232/426] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:42 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:42.805154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:42.819776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:42.825697 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d8ee04ae-98eb-42ee-8c12-bb97301e649b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.383878 Aug 18 17:08:42.825697 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 195/427] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:42 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:43.686973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:43.687751 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:43.710572 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:43.711073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:43.711552 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:43.713526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:43.713526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:43.713526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:43.846729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:43.849532 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:43.860626 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:43.861608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:43.862656 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:43.863789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:43.866595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:43.866595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:44.102245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:44.125534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:44.132479 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:44.137774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7cdb5441-3d63-4a61-9a94-bcf6b301c54f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.455070 Aug 18 17:08:44.138663 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 233/428] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:43 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:44.585999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:44.603321 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6ef6c3bd-10c9-4829-8d3f-6a592b345dbb tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.761523 Aug 18 17:08:44.606080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 196/429] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:43 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:45.168820 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:45.170217 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:45.180546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:45.181421 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:45.182093 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:45.184772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:45.185436 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:45.186041 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:45.521113 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:45.538226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:45.540301 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:45.542727 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5e3cf5fc-40a9-47f4-9292-93aac5024da9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.379944 Aug 18 17:08:45.560664 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 234/430] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:45 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:45.626676 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:45.627363 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:45.640077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:45.643753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:45.644481 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:45.645534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:45.647931 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:45.652247 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:45.949923 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:45.963775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-74cdb27e-a096-4421-8fb7-1af744a82d52 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.340491 Aug 18 17:08:45.977824 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 197/431] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:45 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:46.075184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-30dbb04b-6f89-4e50-8839-b656aa8c3eaa req-04a92754-29c4-4dec-8646-4aaf563d9e37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1", "name": "network-vif-plugged", "status": "completed", "tag": "60e0cf05-5e8f-4133-8579-da77a04a4d8a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:46.128455 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-30dbb04b-6f89-4e50-8839-b656aa8c3eaa req-04a92754-29c4-4dec-8646-4aaf563d9e37 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:46.132572 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-30dbb04b-6f89-4e50-8839-b656aa8c3eaa req-04a92754-29c4-4dec-8646-4aaf563d9e37 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:46.133380 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-30dbb04b-6f89-4e50-8839-b656aa8c3eaa req-04a92754-29c4-4dec-8646-4aaf563d9e37 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:46.173638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-30dbb04b-6f89-4e50-8839-b656aa8c3eaa req-04a92754-29c4-4dec-8646-4aaf563d9e37 service nova] Creating event network-vif-plugged:60e0cf05-5e8f-4133-8579-da77a04a4d8a for instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 on hv-cinder-85367 Aug 18 17:08:46.184133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-30dbb04b-6f89-4e50-8839-b656aa8c3eaa req-04a92754-29c4-4dec-8646-4aaf563d9e37 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122693 Aug 18 17:08:46.185104 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 235/432] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:08:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:08:46.570389 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:46.571617 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:46.578215 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:46.578917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:46.579551 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:46.580269 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:46.580877 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:46.590258 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:46.733383 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:46.741146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:46.742589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:46.743794 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-dc87bb93-7437-48ca-b9ab-2a707ef8e7cc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.181469 Aug 18 17:08:46.744362 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 198/433] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:46 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:46.987021 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:46.988112 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:46.998912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:46.999404 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:46.999872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:47.000588 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:47.002849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:47.005576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:47.318946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:47.332731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-616b3586-80ba-4cff-a890-0dece3394c74 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.345357 Aug 18 17:08:47.348712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 236/434] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:46 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:47.769658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:47.770233 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:47.788973 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:47.789085 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:47.789451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:47.790166 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:47.800330 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:47.801059 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:48.077172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:48.090610 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:48.093471 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:48.105661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-64c2d3da-0c94-456b-b637-6c6d90701a74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.329643 Aug 18 17:08:48.105661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 199/435] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:47 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:48.352379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:48.353591 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:48.365600 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:48.366090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:48.376211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:48.377314 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:48.378032 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:48.378661 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:48.626038 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:48.632899 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:48.636209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7fe624db-77a1-4a82-8afc-9898ce2bba86 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.287445 Aug 18 17:08:48.657580 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 237/436] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:48 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:49.121062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:49.122341 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:49.131042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:49.132027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:49.132662 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:49.133588 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:49.134410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:49.135157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:49.507374 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:49.517794 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:49.531186 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:49.531186 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c82d3765-1ad4-4adb-bbe4-839af5e15e4f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.407964 Aug 18 17:08:49.543644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 200/437] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:49 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:49.658644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:49.659319 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:49.666525 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:49.667289 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:49.667916 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:49.668660 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:49.669119 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:49.669595 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:49.862333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:49.871756 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8eef745c-e04b-42b9-803d-4b3c2c223836 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1259 microversion: 2.1 time: 0.216519 Aug 18 17:08:49.883737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 238/438] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:49 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1259 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:50.561595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:50.562964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:50.570637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:50.571452 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:50.572088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:50.573192 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:50.573838 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:50.574434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:50.730399 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:50.737633 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:50.739156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:50.740372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6a9d3af0-e70e-449d-90be-69a7ad34e163 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.182956 Aug 18 17:08:50.741320 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 201/439] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:50 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:50.899309 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:50.899905 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:50.906377 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:50.906862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:50.907327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:50.908047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:50.908500 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:50.908923 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:51.049586 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:51.057418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cc3a37fb-31d6-4bdd-bcfb-8843d41cb8f4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1442 microversion: 2.1 time: 0.164394 Aug 18 17:08:51.057999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 239/440] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:50 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1442 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:51.078832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:51.079565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:51.085935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:51.086433 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:51.086904 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:51.087631 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:51.088097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:51.088572 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:51.248434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:51.260964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-62a26521-ce4d-43dc-bf30-663cee467827 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1442 microversion: 2.1 time: 0.185261 Aug 18 17:08:51.261568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 202/441] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:51 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1442 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:51.279590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:08:51.280061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Thu Aug 18 17:08:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:08:51.768883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:51.770048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:51.777110 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:51.777808 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:51.778411 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:51.779269 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:51.779899 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:51.780469 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:51.953666 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:51.966993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:51.968967 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:51.970623 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5d5fe98f-293d-4c45-9e66-adb94b35acfa tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.207904 Aug 18 17:08:51.986528 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 240/442] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:51 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:52.770939 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-289826137", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "networks": [{"uuid": "cedc50d6-8585-4b64-a3ce-7cee180068fc"}]}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:52.887156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] validate_networks() for [('cedc50d6-8585-4b64-a3ce-7cee180068fc', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:08:52.994211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:52.995880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:53.011276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:53.012226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:53.012928 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:53.013878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:53.014556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:53.015210 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:53.197216 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:53.206268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:53.214684 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:53.216085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bcf8e221-cfb1-4862-b930-d88c3a32daf8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.225778 Aug 18 17:08:53.216740 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 241/443] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:52 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:53.497217 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:08:53.497717 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:08:53.498205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:08:53.498622 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:08:53.499039 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:08:53.508470 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:53.512624 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:53.513203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:53.514091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:53.514706 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:53.515242 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:53.535743 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Getting quotas for project 50036d9fc240431fbcd0b75ed17248fd. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:08:53.540507 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Getting quotas for user ff492aa3ff514be8a7bfebdf8241e79a and project 50036d9fc240431fbcd0b75ed17248fd. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:08:53.566679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:08:53.573649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:08:53.758328 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7eff5706-3b8b-43fa-92c1-97cc708b26cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.999942 Aug 18 17:08:53.759205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 203/444] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:08:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 1001 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:08:53.795057 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d4d7e746-27a2-4bd1-81a6-fa68a7e4dafc tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:53.796008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d4d7e746-27a2-4bd1-81a6-fa68a7e4dafc tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:53.857930 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d4d7e746-27a2-4bd1-81a6-fa68a7e4dafc tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:53.864888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d4d7e746-27a2-4bd1-81a6-fa68a7e4dafc tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1218 microversion: 2.1 time: 0.090139 Aug 18 17:08:53.865645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 242/445] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:53 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:54.239605 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:54.240472 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:54.247255 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:54.247770 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:54.248196 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:54.248888 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:54.249339 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:54.249757 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:54.429175 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:54.433791 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-acd147b8-9ae9-4b5d-a7f5-62b2faad1460 req-eabbfe61-3dc5-42c2-bca7-a81af9e62951 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1", "tag": "60e0cf05-5e8f-4133-8579-da77a04a4d8a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:54.445833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:54.446417 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-acd147b8-9ae9-4b5d-a7f5-62b2faad1460 req-eabbfe61-3dc5-42c2-bca7-a81af9e62951 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:54.446897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-acd147b8-9ae9-4b5d-a7f5-62b2faad1460 req-eabbfe61-3dc5-42c2-bca7-a81af9e62951 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:54.447324 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-acd147b8-9ae9-4b5d-a7f5-62b2faad1460 req-eabbfe61-3dc5-42c2-bca7-a81af9e62951 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:54.455420 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:54.456805 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3d13a935-3d8e-470c-a69f-4b2366daed53 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.221762 Aug 18 17:08:54.457432 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 204/446] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:54 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:54.471885 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-acd147b8-9ae9-4b5d-a7f5-62b2faad1460 req-eabbfe61-3dc5-42c2-bca7-a81af9e62951 service nova] Creating event network-changed:60e0cf05-5e8f-4133-8579-da77a04a4d8a for instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 on hv-cinder-85367 Aug 18 17:08:54.477366 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-acd147b8-9ae9-4b5d-a7f5-62b2faad1460 req-eabbfe61-3dc5-42c2-bca7-a81af9e62951 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054415 Aug 18 17:08:54.481250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 243/447] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:08:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:08:54.885697 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1d4a0f14-7732-4f9c-8bdd-221890327dbe tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:54.886099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1d4a0f14-7732-4f9c-8bdd-221890327dbe tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:54.999152 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1d4a0f14-7732-4f9c-8bdd-221890327dbe tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:55.009517 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1d4a0f14-7732-4f9c-8bdd-221890327dbe tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1218 microversion: 2.1 time: 0.127537 Aug 18 17:08:55.012733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 205/448] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:54 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:55.485332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:55.486147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:55.492952 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:55.493513 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:55.494062 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:55.495168 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:55.495732 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:55.496160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:55.593686 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-08431a23-2e74-4ef6-9b58-57fef1851da5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Action: 'create', calling method: .version_select at 0x7ff5b571db80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1699644400", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoOxT/jm/1QlNpn9iclOsnIGYxwdUSY3O8IFlJfSnPwfSSqD3i9usdxb+OuTrnaoXqE/TlCimvZha8/M49k4pncIGxK0l5uAO/V4f26sEIifEOvZUg+kC0oy/0m17Z37w=="}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:55.612268 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-08431a23-2e74-4ef6-9b58-57fef1851da5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Getting quotas for project af8df1d9e9b54347aa9f29ead57f2797. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:08:55.616530 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-08431a23-2e74-4ef6-9b58-57fef1851da5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Getting quotas for user d981917c507b4d0e876c50ca35f42cea and project af8df1d9e9b54347aa9f29ead57f2797. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:08:55.630827 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:55.641756 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:55.643769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:55.644938 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-379f3884-c6b7-49ab-9a28-33153ddee918 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.166133 Aug 18 17:08:55.645485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 244/449] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:55 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:55.689584 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2155fe21-f7fd-4b0c-9afb-a88301ba8dd4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:55.690080 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2155fe21-f7fd-4b0c-9afb-a88301ba8dd4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:55.700290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2155fe21-f7fd-4b0c-9afb-a88301ba8dd4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:55.700290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2155fe21-f7fd-4b0c-9afb-a88301ba8dd4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:55.700290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2155fe21-f7fd-4b0c-9afb-a88301ba8dd4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:55.700290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2155fe21-f7fd-4b0c-9afb-a88301ba8dd4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:55.700795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2155fe21-f7fd-4b0c-9afb-a88301ba8dd4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:55.700795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2155fe21-f7fd-4b0c-9afb-a88301ba8dd4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:55.724548 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2155fe21-f7fd-4b0c-9afb-a88301ba8dd4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de/ips" status: 200 len: 149 microversion: 2.1 time: 0.038751 Aug 18 17:08:55.725118 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 245/450] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:08:55 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:08:55.738254 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bb385ea-4cff-4bdd-bbc0-97b100bac9fd"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:55.740599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:55.747137 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:55.747655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:55.748088 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:55.748776 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:55.749227 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:55.749684 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:55.766086 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-08431a23-2e74-4ef6-9b58-57fef1851da5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.176255 Aug 18 17:08:55.767211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 206/451] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:08:55 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:08:55.834639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Invalid volume: volume 1bb385ea-4cff-4bdd-bbc0-97b100bac9fd is already attached to instances: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: POST /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de/os-volume_attachments HTTP/1.1 Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 74 Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:08:55.836481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {"volumeAttachment": {"volumeId": "1bb385ea-4cff-4bdd-bbc0-97b100bac9fd"}} Aug 18 17:08:55.845288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Invalid volume: volume 1bb385ea-4cff-4bdd-bbc0-97b100bac9fd is already attached to instances: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'server_id': '0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de', 'body': {'volumeAttachment': {'volumeId': '1bb385ea-4cff-4bdd-bbc0-97b100bac9fd'}}} Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1bb385ea-4cff-4bdd-bbc0-97b100bac9fd is already attached to instances: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:08:55.846198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1bb385ea-4cff-4bdd-bbc0-97b100bac9fd is already attached to instances: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:08:55.847607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:08:55.848998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:08:55.848998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:08:55.848998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:08:55.848998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1bb385ea-4cff-4bdd-bbc0-97b100bac9fd is already attached to instances: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 Aug 18 17:08:55.848998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:08:55.848998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 400 to user: Invalid volume: volume 1bb385ea-4cff-4bdd-bbc0-97b100bac9fd is already attached to instances: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:08:55.848998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a2e16c6f-7d2e-467a-aa7f-af635cd8418c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103746 Aug 18 17:08:55.848998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 246/452] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:08:55 2022] POST /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 18 17:08:55.849587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:55.849587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:55.854611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:55.855362 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:55.855903 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:55.856634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:55.857224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:55.857661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:55.883476 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:08:55.885014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1578281824", "imageRef": "5bba4b88-f889-401c-b5a2-1f61735d9ea8", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1699644400", "networks": [{"uuid": "dcd0fc6c-6616-4d99-959f-76bbf998b0aa"}]}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:08:55.948701 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.network.neutron [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] validate_networks() for [('dcd0fc6c-6616-4d99-959f-76bbf998b0aa', None, None, None, None, None)] {{(pid=121267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:08:56.238489 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4909b71c-1ff0-4db2-b9c4-782d530f5bb2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 204 len: 0 microversion: 2.1 time: 0.395015 Aug 18 17:08:56.239196 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 207/453] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:08:55 2022] DELETE /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:08:56.248064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:56.248762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:56.254687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:56.255595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:56.255595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:56.256311 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:56.256758 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:56.257172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:56.322370 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Flavor limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:08:56.322874 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Image limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:08:56.323929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Flavor pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:08:56.324022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Image pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:08:56.324411 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:08:56.331079 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:56.334789 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:56.335348 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:56.335839 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:56.336599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:56.337061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:56.337486 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:56.339003 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7e7f39df-a83b-4d4a-bcdd-efa57ab728c7 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1270 microversion: 2.1 time: 0.095656 Aug 18 17:08:56.339621 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 208/454] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:56 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1270 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:56.344179 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:56.345030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:56.351055 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:56.351586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:56.352145 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:56.352844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:56.353489 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:56.354439 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:56.355422 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Getting quotas for project af8df1d9e9b54347aa9f29ead57f2797. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:08:56.359504 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Getting quotas for user d981917c507b4d0e876c50ca35f42cea and project af8df1d9e9b54347aa9f29ead57f2797. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:08:56.371180 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Going to run 1 instances... {{(pid=121267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:08:56.373516 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5bba4b88-f889-401c-b5a2-1f61735d9ea8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:08:56.489614 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:56.497512 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c3a546de-962a-49bd-9b42-b42009e7ff2c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1679 microversion: 2.1 time: 0.156920 Aug 18 17:08:56.498090 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 209/455] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:56 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:56.513642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9e14b327-f6f2-4142-bb8b-130dfb98f5a2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632536 Aug 18 17:08:56.514276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 247/456] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:08:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:08:56.525320 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8de45063-d127-4255-b8d7-735b77864b86 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:56.526591 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8de45063-d127-4255-b8d7-735b77864b86 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:56.580930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8de45063-d127-4255-b8d7-735b77864b86 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:56.588184 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8de45063-d127-4255-b8d7-735b77864b86 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1259 microversion: 2.1 time: 0.066751 Aug 18 17:08:56.589714 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 210/457] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:56 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:56.669122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:56.669979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:56.676350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:56.676829 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:56.677264 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:56.678135 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:56.678590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:56.679005 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:56.824852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:56.834414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:56.835883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:56.837045 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-62f66bbc-ef60-46b4-83c8-4ddba772cfc9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.172748 Aug 18 17:08:56.837593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 248/458] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:56 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:57.360936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:57.361654 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:57.369384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:57.370396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:57.370823 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:57.371558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:57.372021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:57.372512 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:57.437811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:57.445622 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0dd70179-581d-4a0e-bd16-1ceb3a3397fa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1270 microversion: 2.1 time: 0.088941 Aug 18 17:08:57.446187 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 211/459] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:57 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:57.518605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:57.519386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:57.526093 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:57.526577 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:57.527130 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:57.527902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:57.528358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:57.528790 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:57.609821 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:57.610553 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:57.616608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:57.617089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:57.617522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:57.618219 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:57.618672 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:57.619089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:57.660138 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:57.668775 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d277fe64-568e-4c4f-a3d7-7a0be0552f46 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1679 microversion: 2.1 time: 0.154351 Aug 18 17:08:57.669351 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 249/460] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:57 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:57.685029 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:57.694179 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7f685901-d626-4ca3-b8f8-d549c3bfdbdf tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1263 microversion: 2.1 time: 0.087056 Aug 18 17:08:57.694179 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 212/461] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:57 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1263 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:08:57.861143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:57.861668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:57.867641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:57.868124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:57.868555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:57.869235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:57.870359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:57.870781 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:58.000855 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:58.009556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:58.011151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:58.012357 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bec6a28b-c074-474e-8f49-4534d81b3323 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.155206 Aug 18 17:08:58.012920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 250/462] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:57 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:58.466884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:58.467528 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:58.474046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:58.474532 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:58.474971 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:58.475694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:58.476156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:58.476601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:58.548316 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:58.555924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-483954e5-5dd5-47fe-85fa-001b87b658cd tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1270 microversion: 2.1 time: 0.092881 Aug 18 17:08:58.556495 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 213/463] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:58 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:58.690360 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:58.691014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:58.699006 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:58.699942 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:58.700729 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:58.702000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:58.702843 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:58.703699 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:58.713950 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:58.714584 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:58.720779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:58.721798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:58.721798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:58.722431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:58.722890 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:58.723312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:58.743010 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:58.793481 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:58.802641 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-31c51da0-2e95-41f1-8623-333e909c28e8 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1263 microversion: 2.1 time: 0.092996 Aug 18 17:08:58.803983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 214/464] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:58 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1263 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:58.869105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:58.877369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-476bf8da-aca4-462c-9cc8-7c94fe2dd9f0 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1679 microversion: 2.1 time: 0.191050 Aug 18 17:08:58.878183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 251/465] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:58 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1679 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:59.037880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:59.038464 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:59.046405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:59.047477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:59.047930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:59.048665 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:59.050228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:59.050228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:59.569577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:59.580795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:59.582930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:59.585792 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e816abb6-84c7-45d0-8b35-ece3539c3a43 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.552075 Aug 18 17:08:59.586597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:59.587007 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 215/466] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:08:59 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:08:59.588340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:59.593598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=3 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:08:59.600345 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:59.608572 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:59.608572 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:59.608572 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:59.608572 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:59.609137 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:59.695764 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:59.704933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-857a6c4c-f0d2-44b5-9092-62e4fbc5eb30 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1276 microversion: 2.1 time: 0.130799 Aug 18 17:08:59.705778 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 252/467] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:59 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:08:59.824855 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:59.825574 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:59.833019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:59.833668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:59.834147 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:59.834921 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:59.835613 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:59.836107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:59.901286 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:08:59.902313 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:08:59.912634 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:59.914484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:59.915823 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:59.920223 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:08:59.923821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:08:59.928218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:08:59.961234 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:08:59.986307 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e8d337ca-7647-45aa-8493-5a84b286e0c5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1319 microversion: 2.1 time: 0.165860 Aug 18 17:09:00.002346 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 216/468] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:59 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:00.242947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:00.252485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a29a4009-84f6-4637-b0ea-df278f18b2bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1679 microversion: 2.1 time: 0.356355 Aug 18 17:09:00.253673 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 253/469] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:08:59 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1679 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:00.636022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:00.641197 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:00.646106 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:00.648022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:00.648830 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:00.652225 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:00.652697 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:00.653134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:00.726718 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:00.727332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:00.738897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:00.739286 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:00.739744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:00.740445 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:00.740897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:00.741317 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:00.949661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:00.987483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:00.997346 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:01.000549 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4dc5f790-bd9c-46dc-acdd-72bd482fa63f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.370092 Aug 18 17:09:01.004694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 217/470] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:00 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:09:01.024903 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-fd052347-1a38-4d88-835a-be28e8f73cd2 req-1a82d5e4-cac9-4002-952b-55fb75a222e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de", "name": "network-vif-deleted", "tag": "6ece756e-5432-4424-b12d-e1dd5eb8ec5a"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:01.065098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-fd052347-1a38-4d88-835a-be28e8f73cd2 req-1a82d5e4-cac9-4002-952b-55fb75a222e1 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:01.066376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-fd052347-1a38-4d88-835a-be28e8f73cd2 req-1a82d5e4-cac9-4002-952b-55fb75a222e1 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:01.066904 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-fd052347-1a38-4d88-835a-be28e8f73cd2 req-1a82d5e4-cac9-4002-952b-55fb75a222e1 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:01.110380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-fd052347-1a38-4d88-835a-be28e8f73cd2 req-1a82d5e4-cac9-4002-952b-55fb75a222e1 service nova] Creating event network-vif-deleted:6ece756e-5432-4424-b12d-e1dd5eb8ec5a for instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de on hv-cinder-85367 Aug 18 17:09:01.116504 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-fd052347-1a38-4d88-835a-be28e8f73cd2 req-1a82d5e4-cac9-4002-952b-55fb75a222e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108849 Aug 18 17:09:01.117817 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 218/471] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:01.126102 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:01.127584 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:01.136710 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:01.137887 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:01.138752 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:01.140000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:01.141233 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:01.142337 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:01.144709 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:01.159268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-df647aa6-8ff7-4b65-beb3-6fc6c040050a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.431465 Aug 18 17:09:01.159268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 254/472] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:00 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:01.281927 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:01.282452 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:01.298920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:01.299414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:01.311611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:01.312750 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:01.319148 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:01.325779 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:01.409542 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:01.410287 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:01.410881 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:01.411533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:01.527428 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:01.536484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1f62c501-2cfe-40cc-94f7-f560b04832bc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.259414 Aug 18 17:09:01.537517 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 255/473] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:01 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:01.690651 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:01.700798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9456c486-1e31-498c-816e-899a3c58e95c tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.581401 Aug 18 17:09:01.724619 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 219/474] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:01 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:02.031287 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:02.032001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:02.050882 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.051370 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.051845 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.052569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.053024 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.053447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.129561 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-7b054c50-81e4-4353-b519-39f52042d263 req-b8aef4c4-6901-49f8-885a-770f93814fc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e481aa-bf5a-436b-baca-f5c8b88de401", "name": "network-vif-plugged", "status": "completed", "tag": "9d480631-4b24-43e0-8000-c7d4668399bb"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:02.148803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:02.162819 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-7b054c50-81e4-4353-b519-39f52042d263 req-b8aef4c4-6901-49f8-885a-770f93814fc3 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.164792 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-7b054c50-81e4-4353-b519-39f52042d263 req-b8aef4c4-6901-49f8-885a-770f93814fc3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.168687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-7b054c50-81e4-4353-b519-39f52042d263 req-b8aef4c4-6901-49f8-885a-770f93814fc3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.208784 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-7b054c50-81e4-4353-b519-39f52042d263 req-b8aef4c4-6901-49f8-885a-770f93814fc3 service nova] Creating event network-vif-plugged:9d480631-4b24-43e0-8000-c7d4668399bb for instance 68e481aa-bf5a-436b-baca-f5c8b88de401 on hv-cinder-85367 Aug 18 17:09:02.220524 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-7b054c50-81e4-4353-b519-39f52042d263 req-b8aef4c4-6901-49f8-885a-770f93814fc3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098081 Aug 18 17:09:02.223106 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 220/475] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:02.232144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:02.234759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:02.247121 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.247946 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.248793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.249756 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.250513 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.251755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.466318 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:02.471143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:02.497462 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:02.508097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:02.509586 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3549d048-8a60-4577-bc44-6323abfecc65 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.482166 Aug 18 17:09:02.517855 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 256/476] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:02 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:09:02.562949 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:02.565317 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:02.573682 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:02.582821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.584813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.585758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.603501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.603501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.603501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.604811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9c661fa4-644e-407a-8f90-820bc4d9d228 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.372286 Aug 18 17:09:02.604811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 221/477] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:02 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:02.681271 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.682193 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.682824 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.683521 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:02.730063 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:02.730614 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:02.743783 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.744300 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.744744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.745471 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:02.750119 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:02.751273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:02.807889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:02.821668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-272ed129-f3a3-45df-99c5-0ccacba5a0c1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.265172 Aug 18 17:09:02.824111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 257/478] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:02 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:03.039377 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:03.049779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6a9f1178-7af5-46ef-a708-5653a91e9bd1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.324068 Aug 18 17:09:03.050908 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 222/479] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:02 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:03.128236 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-4657d95b-cc57-4474-927e-e9237e7a3bc7 req-0e0e217e-5d96-40d2-8ff3-e770148fe76b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c79a7d-abff-4d4f-aecc-309441c5e3bc", "tag": "2ee00035-edc8-4a51-89b1-4dc0e2c5a468"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:03.140335 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-4657d95b-cc57-4474-927e-e9237e7a3bc7 req-0e0e217e-5d96-40d2-8ff3-e770148fe76b service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:03.141803 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-4657d95b-cc57-4474-927e-e9237e7a3bc7 req-0e0e217e-5d96-40d2-8ff3-e770148fe76b service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:03.142419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-4657d95b-cc57-4474-927e-e9237e7a3bc7 req-0e0e217e-5d96-40d2-8ff3-e770148fe76b service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:03.157330 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-c096a589-cad7-48cc-b484-7758f45ce731 req-142057e1-a100-477c-9e4b-c23e92995ea5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9d8d9fd-f9dc-4547-8a84-228a57dce5e4", "tag": "0c77e253-eb7e-4f3b-a573-87f2912d98d0"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:03.180153 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-c096a589-cad7-48cc-b484-7758f45ce731 req-142057e1-a100-477c-9e4b-c23e92995ea5 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:03.180724 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-c096a589-cad7-48cc-b484-7758f45ce731 req-142057e1-a100-477c-9e4b-c23e92995ea5 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:03.183888 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-c096a589-cad7-48cc-b484-7758f45ce731 req-142057e1-a100-477c-9e4b-c23e92995ea5 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:03.197079 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-4657d95b-cc57-4474-927e-e9237e7a3bc7 req-0e0e217e-5d96-40d2-8ff3-e770148fe76b service nova] Creating event network-changed:2ee00035-edc8-4a51-89b1-4dc0e2c5a468 for instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc on hv-cinder-85367 Aug 18 17:09:03.209125 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-4657d95b-cc57-4474-927e-e9237e7a3bc7 req-0e0e217e-5d96-40d2-8ff3-e770148fe76b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084967 Aug 18 17:09:03.211579 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 258/480] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:09:03.218285 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-c096a589-cad7-48cc-b484-7758f45ce731 req-142057e1-a100-477c-9e4b-c23e92995ea5 service nova] Creating event network-changed:0c77e253-eb7e-4f3b-a573-87f2912d98d0 for instance c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 on hv-cinder-85367 Aug 18 17:09:03.225521 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-c096a589-cad7-48cc-b484-7758f45ce731 req-142057e1-a100-477c-9e4b-c23e92995ea5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073096 Aug 18 17:09:03.225521 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 223/481] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:09:03.546800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:03.547640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:03.571630 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:03.572629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:03.573394 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:03.574415 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:03.575278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:03.576061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:03.624046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:03.625492 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:03.628602 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:03.640056 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:03.640554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:03.641074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:03.641705 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:03.642165 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:03.642875 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:03.808798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:03.818554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-50d241fb-f4e8-4c83-8807-64363f07e88a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.200380 Aug 18 17:09:03.819150 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 224/482] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:03 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:03.844435 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:03.845054 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:03.851429 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:03.851954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:03.852658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:03.853558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:03.854567 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:03.854999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:03.897011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:03.897511 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:03.897943 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:03.898408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:03.949787 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:03.959875 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0d3af8b2-2be7-4351-bfc2-4bf1f9f4bf8e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.119279 Aug 18 17:09:03.960919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 225/483] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:03 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:04.042175 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:04.051682 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:04.053154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:04.054306 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-23743a2a-4ba2-4d48-87ec-e9bbeb1e7ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.513762 Aug 18 17:09:04.054860 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 259/484] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:03 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:09:04.071340 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:04.071553 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:04.077769 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:04.078254 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:04.078693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:04.079390 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:04.079978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:04.080570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:04.226974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:04.235995 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-63108701-1752-4d1b-ad45-6ab9f4b4cf8e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.169209 Aug 18 17:09:04.236590 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 226/485] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:04 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:04.839619 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:04.840430 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:04.847606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:04.848098 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:04.848535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:04.849234 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:04.849688 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:04.850109 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:04.981502 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:04.982118 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:04.988813 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:04.989341 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:04.989770 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:04.990464 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:04.990914 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:04.991333 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:04.997990 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:05.005533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-89260379-5a5d-4d54-a499-f114e1222b33 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.169856 Aug 18 17:09:05.006105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 260/486] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:04 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:05.029450 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:05.030203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:05.030801 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:05.031270 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:05.077826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:05.078905 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:05.080739 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:05.085571 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:05.086328 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:05.087084 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:05.087912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:05.088612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:05.088930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-641aab6b-b660-41a9-9d30-6a92a17a7735 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.111281 Aug 18 17:09:05.089468 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:05.089836 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 227/487] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:04 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:05.231248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:05.249837 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:05.251495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:05.253037 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bf5e8a62-27f3-4e1b-9fa1-92e113b74a03 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.179302 Aug 18 17:09:05.254128 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 261/488] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:05 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:09:05.257272 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:05.257887 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:05.270286 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:05.270793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:05.271239 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:05.271988 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:05.272485 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:05.272964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:05.418812 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:05.426749 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-dccb822a-cb9e-4438-90c3-384a281145b1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.173309 Aug 18 17:09:05.427325 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 228/489] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:05 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:06.026225 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:06.026823 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:06.033605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:06.034118 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:06.034544 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:06.035238 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:06.035773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:06.041888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:06.113498 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:06.115154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:06.130658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:06.131162 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:06.131641 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:06.132354 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:06.132812 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:06.136242 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:06.180390 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:06.186605 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:06.187299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:06.187915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:06.188523 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:06.191537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1b60f4a0-69a5-437e-a7cb-5b3a9120b75f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.168852 Aug 18 17:09:06.192347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 262/490] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:06 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:06.232093 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:06.239695 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-08c6286a-1a3b-4688-86c4-3776a263be3a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.130733 Aug 18 17:09:06.240258 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 229/491] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:06 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:06.276995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:06.277647 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:06.284080 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:06.284577 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:06.285017 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:06.286000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:06.286174 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:06.286596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:06.345440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:06.366294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=8 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:06.437559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:06.447929 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:06.448586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:06.449311 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:06.454836 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:06.455331 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:06.455818 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:06.456009 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:06.456525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:06.456985 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:06.457341 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e542b09e-f1fe-4240-9fa4-454773301c2a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.184803 Aug 18 17:09:06.457449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:06.458057 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 263/492] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:06 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:09:06.585090 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=14 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:06.619970 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:06.627699 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c2143271-4672-4c0e-8467-33aec7ddad18 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.184170 Aug 18 17:09:06.628607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 230/493] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:06 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:07.212375 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:07.213010 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:07.219368 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:07.219887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:07.220324 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:07.221013 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:07.221470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:07.221979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:07.261707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:07.263307 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:07.270969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:07.271722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:07.272348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:07.273621 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:07.274074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:07.274494 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:07.311723 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:07.312213 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:07.312642 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:07.313244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:07.364044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:07.364761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=100 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:07.365255 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:07.370107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-397ee5bc-e298-4419-856e-cfa889b6a225 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.113186 Aug 18 17:09:07.370721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 231/494] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:07 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:07.374762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c81e852e-d896-4a98-a55d-07e32ab5bd37 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.166004 Aug 18 17:09:07.375534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 264/495] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:07 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:07.483287 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:07.484086 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:07.491047 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:07.492146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:07.492700 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:07.493436 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:07.493906 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:07.494948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:07.654496 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:07.655833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:07.656666 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:07.663235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:07.663768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:07.664137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:07.664262 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:07.664893 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:07.665350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:07.669174 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:07.669333 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:07.669333 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6a7c873c-09bb-4573-a0c6-ca40db3da5ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.189456 Aug 18 17:09:07.677771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 232/496] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:07 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:09:07.821083 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:07.829931 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9d390647-7cb0-4912-b255-9d0e9ee3d575 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.177880 Aug 18 17:09:07.836252 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 265/497] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:07 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:08.390738 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:08.395982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:08.398114 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.398611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.399052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.399801 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.400259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.401297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.403236 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:08.404064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:08.413073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.414099 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.414559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.415724 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.416312 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.416881 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.448536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.449189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.449755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.450301 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:08.495733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:08.503593 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ddf34742-206c-4f22-b838-23db1ef9dd66 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.116702 Aug 18 17:09:08.504424 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 233/498] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:08 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:08.565804 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:08.575191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fac76e2a-a0e6-4b27-aed7-7803450535cf tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.177624 Aug 18 17:09:08.582903 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 266/499] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:08 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:08.692103 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:08.692806 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:08.700091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.700711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.701038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.701742 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.702197 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.702810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.845778 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:08.850640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:08.853349 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:08.855601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:08.857139 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:08.857728 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.858226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.858545 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2da0016f-07b1-4ec9-be3f-d8ff80c70119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.170536 Aug 18 17:09:08.858656 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.859103 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 234/500] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:08 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:09:08.859345 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.860025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.860456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.988314 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7f44147a-f5d7-46b8-8149-558c53eea566 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2612312-4a00-402b-862e-7c85ad43ed39"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:08.990810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7f44147a-f5d7-46b8-8149-558c53eea566 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:08.997212 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f44147a-f5d7-46b8-8149-558c53eea566 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.998147 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f44147a-f5d7-46b8-8149-558c53eea566 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:08.998624 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f44147a-f5d7-46b8-8149-558c53eea566 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:08.999378 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f44147a-f5d7-46b8-8149-558c53eea566 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:08.999865 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f44147a-f5d7-46b8-8149-558c53eea566 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:09.000291 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f44147a-f5d7-46b8-8149-558c53eea566 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:09.005182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:09.013568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-940223cd-e93b-4835-b172-0ab93c972966 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.166693 Aug 18 17:09:09.014297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 267/501] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:08 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:09.525762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:09.526438 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:09.533373 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:09.533852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:09.534289 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:09.534993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:09.535462 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:09.535917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:09.570611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:09.571096 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:09.571563 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:09.572048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:09.622921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:09.631201 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5967af95-3a23-4ed8-959f-32e3d3c6fcd3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.109912 Aug 18 17:09:09.632032 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 268/502] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:09 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:09.636687 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:09.637365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:09.643917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:09.644407 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:09.645014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:09.645846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:09.646304 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:09.646723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:09.794030 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:09.801989 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3c848271-ad0d-44dd-9979-6c43e5d00ba1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.169123 Aug 18 17:09:09.802579 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 269/503] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:09 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:09.887670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:09.888282 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:09.894480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:09.894958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:09.895391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:09.896120 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:09.896576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:09.896999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:10.041796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:10.050945 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:10.052566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:10.053811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9aac410f-dfa6-4a91-818c-34f90e9d7529 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.170247 Aug 18 17:09:10.054365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 270/504] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:09 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:09:10.058911 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:10.059551 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:10.065521 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:10.066002 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:10.066434 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:10.067126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:10.067607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:10.068028 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:10.212482 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:10.222862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-caa99b9e-129f-4044-8831-39a2c9e9b204 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.167529 Aug 18 17:09:10.223430 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 271/505] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:10 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:10.655174 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:10.656694 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:10.666702 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:10.667711 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:10.668430 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:10.669429 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:10.670247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:10.670971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:10.717428 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:10.718034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:10.718552 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:10.719012 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:10.772847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:10.781614 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d42eaba7-2584-4ae4-9e79-3bba27a8736a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.131256 Aug 18 17:09:10.788738 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 272/506] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:10 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:10.825160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:10.825760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:10.832107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:10.832582 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:10.833042 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:10.833728 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:10.834176 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:10.834586 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:10.838731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:10.979138 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:10.987124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f5557e2b-30f5-4c4d-9b22-e453885cdb1e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.166705 Aug 18 17:09:10.988807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 273/507] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:10 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:11.078710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:11.079333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:11.085665 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:11.086160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:11.086603 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:11.087333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:11.087850 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:11.088280 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:11.231972 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:11.243979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:11.246388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:11.247744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1723f17b-eeec-472e-8f32-0c9f79fe93fb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.172906 Aug 18 17:09:11.253617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 274/508] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:11 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:09:11.253617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:11.253617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:11.259803 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:11.260364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:11.260874 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:11.261643 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:11.262330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:11.262820 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:11.398585 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:11.407306 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-73a1750b-857f-40fe-9159-4545126b9f99 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.157892 Aug 18 17:09:11.407909 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 275/509] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:11 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:11.802351 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:11.802983 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:11.809539 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:11.810022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:11.810596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:11.811285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:11.811780 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:11.812205 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:11.845879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:11.846366 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:11.846800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:11.847254 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:11.891132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:11.899365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-204fa785-9d89-4f63-9390-5d6081a4049c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 200 len: 1330 microversion: 2.1 time: 0.101030 Aug 18 17:09:11.900124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 276/510] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:11 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 1330 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:12.008845 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:12.009460 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:12.016071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:12.016554 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:12.017012 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:12.017940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:12.018400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:12.018823 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:12.154165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:12.162070 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-eb0f748e-18c3-4706-91b1-5555fe860a3e tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.157289 Aug 18 17:09:12.168175 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 277/511] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:12 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:12.270752 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:12.271419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:12.278791 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:12.278791 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:12.279173 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:12.279932 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:12.280332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:12.280758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:12.534589 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:12.544537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:12.546109 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:12.547365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a68d04b7-de47-44bd-bbc9-5b4fb8c015fc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.280789 Aug 18 17:09:12.548181 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 278/512] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:12 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:09:12.561169 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:12.563142 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:12.569304 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:12.569801 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:12.570233 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:12.570944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:12.571391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:12.571899 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:12.812858 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:12.820824 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0906ff72-1e76-4d59-8257-3fd5caa03c1e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.264993 Aug 18 17:09:12.821404 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 279/513] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:12 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:12.919685 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7f44147a-f5d7-46b8-8149-558c53eea566 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.935296 Aug 18 17:09:12.920325 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 235/514] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:09:08 2022] POST /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments => generated 194 bytes in 3937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:09:12.922358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:12.923056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:12.929369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:12.929856 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:12.930288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:12.931049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:12.932073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:12.932510 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:12.946667 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de HTTP/1.1 Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:09:12.949230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:09:12.950597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de'} Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:09:12.951392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:09:12.952809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:12.954079 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:09:12.954079 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5ef2646c-72de-448b-9f02-ab1b5bb21f6b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 404 len: 111 microversion: 2.1 time: 0.033636 Aug 18 17:09:12.954079 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 280/515] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:12 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:09:12.968849 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ef544938-9ad5-4f85-b401-734c9e14c085 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '.version_select at 0x7ff5b4e6e310>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:13.044290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ef544938-9ad5-4f85-b401-734c9e14c085 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-665410517" status: 202 len: 0 microversion: 2.1 time: 0.079746 Aug 18 17:09:13.044875 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 236/516] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Aug 18 17:09:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-665410517 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:09:13.183732 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:13.184340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:13.190327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:13.190808 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:13.191238 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:13.191964 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:13.192416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:13.192848 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:13.342992 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:13.350689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cc1064f0-73f3-4fba-872a-c08918d8d1b4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.171334 Aug 18 17:09:13.351258 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 281/517] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:13 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:13.571030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:13.571817 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:13.578052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:13.583397 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:13.583397 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:13.583397 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:13.583397 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:13.584011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:13.737293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:13.746068 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:13.747663 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:13.748821 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c6d88df7-b835-4fab-919e-e840bda3a4a0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.182559 Aug 18 17:09:13.749375 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 237/518] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:13 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:09:13.842614 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:13.843243 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:13.849686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:13.850194 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:13.850630 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:13.851361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:13.851841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:13.852265 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:13.926455 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:13.929897 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:13.933175 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:13.933647 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:13.934074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:13.934765 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:13.935213 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:13.935664 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:13.992440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:14.000487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f2c1da71-0bde-478d-b9a7-81b2637c77dd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.161751 Aug 18 17:09:14.001372 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 282/519] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:13 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:14.079236 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'services' on Instance uuid e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:14.351166 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8cd52f59-158a-4880-b25a-14100a7b0ccd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments/1bb385ea-4cff-4bdd-bbc0-97b100bac9fd" status: 202 len: 0 microversion: 2.1 time: 0.428616 Aug 18 17:09:14.351804 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 238/520] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:09:13 2022] DELETE /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments/1bb385ea-4cff-4bdd-bbc0-97b100bac9fd => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 17:09:14.360643 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-16839fe6-d0dc-4ac7-a012-ec7de395542e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:14.363134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-16839fe6-d0dc-4ac7-a012-ec7de395542e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:14.370423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16839fe6-d0dc-4ac7-a012-ec7de395542e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:14.371130 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16839fe6-d0dc-4ac7-a012-ec7de395542e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:14.371791 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16839fe6-d0dc-4ac7-a012-ec7de395542e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:14.372807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16839fe6-d0dc-4ac7-a012-ec7de395542e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:14.373431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16839fe6-d0dc-4ac7-a012-ec7de395542e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:14.374015 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-16839fe6-d0dc-4ac7-a012-ec7de395542e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:14.379614 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:14.380343 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:14.389301 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:14.390233 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:14.390852 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:14.391783 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:14.392520 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:14.392947 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:14.410947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-16839fe6-d0dc-4ac7-a012-ec7de395542e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054039 Aug 18 17:09:14.412036 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 283/521] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:09:14 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:14.718113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:14.725803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-940ed5a9-b27e-46d8-b157-bec8289f77c8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.353753 Aug 18 17:09:14.726371 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 239/522] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:14 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:14.772094 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:14.772712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:14.778703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:14.779639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:14.779639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:14.780344 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:14.780782 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:14.781206 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:14.911357 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:14.920644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:14.922196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:14.923361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-12b09db4-5f4d-4c18-8cb9-688d4b1bd092 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.155287 Aug 18 17:09:14.923973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 284/523] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:14 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:09:15.022049 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:15.022852 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:15.029474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:15.029983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:15.030394 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:15.031096 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:15.031600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:15.032027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:15.173522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:15.181174 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-55e1df54-51e3-42b1-b839-604a6f8bd33d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.162945 Aug 18 17:09:15.183725 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 240/524] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:15 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:15.424392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0dd7e54f-15fa-4c32-a23d-9a220c7af55d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:15.428490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0dd7e54f-15fa-4c32-a23d-9a220c7af55d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:15.437420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0dd7e54f-15fa-4c32-a23d-9a220c7af55d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:15.438042 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0dd7e54f-15fa-4c32-a23d-9a220c7af55d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:15.438556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0dd7e54f-15fa-4c32-a23d-9a220c7af55d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:15.439339 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0dd7e54f-15fa-4c32-a23d-9a220c7af55d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:15.439959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0dd7e54f-15fa-4c32-a23d-9a220c7af55d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:15.440462 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0dd7e54f-15fa-4c32-a23d-9a220c7af55d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:15.475400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0dd7e54f-15fa-4c32-a23d-9a220c7af55d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055724 Aug 18 17:09:15.476115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 285/525] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:09:15 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:15.746389 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:15.749406 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:15.757845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:15.758483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:15.760097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:15.761104 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:15.761763 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:15.762231 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:15.964134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:15.964134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:15.964134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:15.964134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:15.966918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:15.966918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:15.966918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:15.966918 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:16.017395 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:16.025784 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5187231f-d58d-4b26-83bb-c38984412a62 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.283340 Aug 18 17:09:16.031341 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 241/526] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:15 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:16.133124 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:16.146921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:16.149701 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:16.154078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ad3c3df1-e393-4ed7-b1ea-c1b590e98614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.211793 Aug 18 17:09:16.155072 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 286/527] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:15 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:09:16.204006 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:16.204624 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:16.210747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:16.211233 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:16.211704 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:16.212414 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:16.212900 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:16.213332 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:16.386492 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:16.399621 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d6debc07-982b-4bbd-98c3-dacf77aae538 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.199386 Aug 18 17:09:16.400239 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 242/528] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:16 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:16.489610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-377e71b9-7dd4-4629-9c81-77a51fc86fe4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:16.490780 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-377e71b9-7dd4-4629-9c81-77a51fc86fe4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:16.498652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-377e71b9-7dd4-4629-9c81-77a51fc86fe4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:16.499145 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-377e71b9-7dd4-4629-9c81-77a51fc86fe4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:16.499714 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-377e71b9-7dd4-4629-9c81-77a51fc86fe4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:16.502599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-377e71b9-7dd4-4629-9c81-77a51fc86fe4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:16.502599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-377e71b9-7dd4-4629-9c81-77a51fc86fe4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:16.502599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-377e71b9-7dd4-4629-9c81-77a51fc86fe4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:16.536332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-377e71b9-7dd4-4629-9c81-77a51fc86fe4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051316 Aug 18 17:09:16.537049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 287/529] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:09:16 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:17.047203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:17.049392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:17.055180 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:17.055948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:17.056656 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:17.057616 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:17.058107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:17.058663 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:17.177311 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:17.178099 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:17.185246 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:17.185756 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:17.186183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:17.186912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:17.187355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:17.187796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:17.197552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:17.208283 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-57d2e823-2f13-4283-926b-63b095332ab9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.164915 Aug 18 17:09:17.209575 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 243/530] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:17 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:17.332092 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:17.340847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:17.342357 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:17.343614 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-346e8603-c2fc-45f8-9486-ebcffb13b5a6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1808 microversion: 2.20 time: 0.170249 Aug 18 17:09:17.344122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 288/531] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:17 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:09:17.427915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:17.428434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:17.434508 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:17.434985 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:17.435414 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:17.436122 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:17.436570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:17.436996 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:17.552060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2faa7f4d-69d0-4423-a750-63f0dd1960b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:17.554961 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2faa7f4d-69d0-4423-a750-63f0dd1960b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:17.562358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2faa7f4d-69d0-4423-a750-63f0dd1960b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:17.562846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2faa7f4d-69d0-4423-a750-63f0dd1960b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:17.563386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2faa7f4d-69d0-4423-a750-63f0dd1960b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:17.564149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2faa7f4d-69d0-4423-a750-63f0dd1960b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:17.564607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2faa7f4d-69d0-4423-a750-63f0dd1960b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:17.565123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2faa7f4d-69d0-4423-a750-63f0dd1960b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:17.566412 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:17.575533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3d952469-1440-4c8b-aff3-1b2bcd3e5146 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.151585 Aug 18 17:09:17.576129 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 244/532] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:17 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:17.598355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2faa7f4d-69d0-4423-a750-63f0dd1960b8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050251 Aug 18 17:09:17.598897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 289/533] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:09:17 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:09:18.025819 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-a7508405-e572-4b6f-9e0b-52dadba73a21 req-46a96540-605b-44bb-ba82-4ae0f52058d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d8d9fd-f9dc-4547-8a84-228a57dce5e4", "name": "network-vif-plugged", "status": "completed", "tag": "0c77e253-eb7e-4f3b-a573-87f2912d98d0"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:18.035719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-a7508405-e572-4b6f-9e0b-52dadba73a21 req-46a96540-605b-44bb-ba82-4ae0f52058d9 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.036203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-a7508405-e572-4b6f-9e0b-52dadba73a21 req-46a96540-605b-44bb-ba82-4ae0f52058d9 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.036648 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-a7508405-e572-4b6f-9e0b-52dadba73a21 req-46a96540-605b-44bb-ba82-4ae0f52058d9 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.048541 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-a7508405-e572-4b6f-9e0b-52dadba73a21 req-46a96540-605b-44bb-ba82-4ae0f52058d9 service nova] Creating event network-vif-plugged:0c77e253-eb7e-4f3b-a573-87f2912d98d0 for instance c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 on hv-cinder-85367 Aug 18 17:09:18.053339 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-a7508405-e572-4b6f-9e0b-52dadba73a21 req-46a96540-605b-44bb-ba82-4ae0f52058d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031444 Aug 18 17:09:18.053920 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 245/534] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:18.238105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:18.238712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:18.245846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.246297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.246810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.247541 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.247999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.248433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.252929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:18.368498 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:18.369306 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:18.376835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.377326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.377764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.378522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.378989 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.379428 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.407057 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:18.416745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-df4fdcf2-04f7-4d7b-8807-48a6a97733aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.182783 Aug 18 17:09:18.417320 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 290/535] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:18 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:18.521713 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:18.530961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:18.532534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:18.533706 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3f4ec91c-2973-49ad-a532-5a439d14ea97 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1795 microversion: 2.20 time: 0.170134 Aug 18 17:09:18.534263 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 246/536] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:09:18 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1795 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:09:18.596386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:18.596989 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:18.602942 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.603489 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.603916 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.606224 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.606224 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.606224 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.611975 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-37a798d4-af65-4b78-8663-d2aad6cbb05e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:18.614349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-37a798d4-af65-4b78-8663-d2aad6cbb05e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:18.620948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-37a798d4-af65-4b78-8663-d2aad6cbb05e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.623930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-37a798d4-af65-4b78-8663-d2aad6cbb05e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.624396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-37a798d4-af65-4b78-8663-d2aad6cbb05e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.626211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-37a798d4-af65-4b78-8663-d2aad6cbb05e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.626703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-37a798d4-af65-4b78-8663-d2aad6cbb05e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.627191 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-37a798d4-af65-4b78-8663-d2aad6cbb05e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.656335 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:18.660577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-37a798d4-af65-4b78-8663-d2aad6cbb05e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052875 Aug 18 17:09:18.661157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 247/537] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:09:18 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:09:18.725207 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:18.725715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:18.732507 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.732990 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.733438 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.734143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:18.734601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:18.735022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:18.746496 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:18.754568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-764494c7-148b-4c50-a1c0-613919a4dda3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.162025 Aug 18 17:09:18.755183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 291/538] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:18 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:18.762705 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:09:19.075661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5ea02ffe-91e2-4b09-bcb1-0fecabe14d9c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 204 len: 0 microversion: 2.1 time: 0.353984 Aug 18 17:09:19.076331 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 248/539] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:09:18 2022] DELETE /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 17:09:19.084607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:19.085317 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:19.091393 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:19.091908 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:19.092387 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:19.093069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:19.093520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:19.093950 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:19.223127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:19.231072 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bf5d85db-155b-4263-9553-928f46e0a9a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1682 microversion: 2.1 time: 0.150418 Aug 18 17:09:19.231690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 292/540] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:19 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:19.438293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:19.438985 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:19.444928 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:19.445403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:19.445890 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:19.446574 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:19.447052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:19.447489 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:19.580535 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:19.588410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2b358889-801b-4ae8-84ab-46a3bb5ff0e5 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.154253 Aug 18 17:09:19.588983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 249/541] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:19 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:19.776859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:19.777480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:19.789676 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:19.790163 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:19.791215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:19.791920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:19.792386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:19.792804 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:19.923594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:19.931714 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e49e3118-3a97-4a00-a61f-61f1fd6a2283 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.158816 Aug 18 17:09:19.932279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 293/542] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:19 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:20.252991 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:20.253612 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:20.260082 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:20.260564 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:20.261003 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:20.261696 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:20.262151 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:20.262577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:20.400866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:20.409460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-906c9926-7daa-4a48-81ec-f442dc79040b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1682 microversion: 2.1 time: 0.160362 Aug 18 17:09:20.415247 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 250/543] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:20 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:20.609827 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:20.610367 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:20.616492 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:20.616975 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:20.617411 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:20.618153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:20.618613 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:20.619253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:20.756100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:20.766394 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8948ddb1-76cb-491f-84ca-247a1cf15df4 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1318 microversion: 2.1 time: 0.160673 Aug 18 17:09:20.767282 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 294/544] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:20 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:20.952798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:20.953981 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:20.959905 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:20.960999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:20.961446 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:20.962204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:20.963300 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:20.963861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:21.097100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:21.105067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-62e3cebc-77b9-4b57-94d2-958281975a19 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.156191 Aug 18 17:09:21.105645 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 251/545] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:20 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:21.430764 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:21.431927 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:21.438507 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:21.438996 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:21.439466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:21.440167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:21.440625 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:21.441049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:21.588877 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:21.607584 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-91045e20-128e-4640-a54d-f6a2abcc002d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1682 microversion: 2.1 time: 0.170004 Aug 18 17:09:21.607584 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 295/546] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:21 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:21.787653 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:21.788774 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:21.795813 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:21.796284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:21.796714 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:21.797404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:21.798021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:21.798592 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:22.009356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:22.018049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-c51d5403-cb4a-45f4-9697-e309d00f9ec4 req-5f9d6585-0a24-4ce1-9d24-33ca370c0d60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c79a7d-abff-4d4f-aecc-309441c5e3bc", "name": "network-vif-plugged", "status": "completed", "tag": "2ee00035-edc8-4a51-89b1-4dc0e2c5a468"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:22.023243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-cac1d4e3-46ef-49c1-b416-7a170883c8e3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1507 microversion: 2.1 time: 0.236990 Aug 18 17:09:22.023952 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 252/547] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:21 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1507 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:22.032659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-c51d5403-cb4a-45f4-9697-e309d00f9ec4 req-5f9d6585-0a24-4ce1-9d24-33ca370c0d60 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:22.044243 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-c51d5403-cb4a-45f4-9697-e309d00f9ec4 req-5f9d6585-0a24-4ce1-9d24-33ca370c0d60 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:22.044243 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-c51d5403-cb4a-45f4-9697-e309d00f9ec4 req-5f9d6585-0a24-4ce1-9d24-33ca370c0d60 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:22.051321 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-c51d5403-cb4a-45f4-9697-e309d00f9ec4 req-5f9d6585-0a24-4ce1-9d24-33ca370c0d60 service nova] Creating event network-vif-plugged:2ee00035-edc8-4a51-89b1-4dc0e2c5a468 for instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc on hv-cinder-85367 Aug 18 17:09:22.060850 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-c51d5403-cb4a-45f4-9697-e309d00f9ec4 req-5f9d6585-0a24-4ce1-9d24-33ca370c0d60 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049994 Aug 18 17:09:22.062001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 296/548] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:22.125708 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:22.126322 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:22.140297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:22.140797 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:22.147550 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:22.147550 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:22.147550 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:22.148100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:22.452483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:22.462097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6b5e846a-c7c7-4e0d-a417-cc59d09cff25 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.340279 Aug 18 17:09:22.463795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 253/549] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:22 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:22.620592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:22.622259 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:22.625263 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:22.632034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:22.632566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:22.633190 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:22.634052 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:22.635260 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:22.635731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:22.715229 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:22.724659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c0b991cb-98b5-4029-b7bf-b62ca5f86d40 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1615 microversion: 2.1 time: 0.109558 Aug 18 17:09:22.726063 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 297/550] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:22 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1615 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:22.973100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-69592c23-31b2-4f38-bf84-95fafe31acf6 req-43d44f6a-e63e-4c6b-b0b9-7a0150d76491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989", "name": "network-vif-deleted", "tag": "ed89df0f-8d34-4c21-9aa8-bc66ad76bcbf"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:22.983202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-69592c23-31b2-4f38-bf84-95fafe31acf6 req-43d44f6a-e63e-4c6b-b0b9-7a0150d76491 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:22.983809 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-69592c23-31b2-4f38-bf84-95fafe31acf6 req-43d44f6a-e63e-4c6b-b0b9-7a0150d76491 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:22.984248 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-69592c23-31b2-4f38-bf84-95fafe31acf6 req-43d44f6a-e63e-4c6b-b0b9-7a0150d76491 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:22.996782 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-69592c23-31b2-4f38-bf84-95fafe31acf6 req-43d44f6a-e63e-4c6b-b0b9-7a0150d76491 service nova] Creating event network-vif-deleted:ed89df0f-8d34-4c21-9aa8-bc66ad76bcbf for instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 on hv-cinder-85367 Aug 18 17:09:23.001886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-69592c23-31b2-4f38-bf84-95fafe31acf6 req-43d44f6a-e63e-4c6b-b0b9-7a0150d76491 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032496 Aug 18 17:09:23.002461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 254/551] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:23.484383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:23.487302 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:23.491995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:23.492483 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:23.493098 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:23.493969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:23.494428 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:23.494847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:23.645311 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:23.654110 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3ffcef6b-7ee6-4de3-a064-def050998847 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1359 microversion: 2.1 time: 0.173677 Aug 18 17:09:23.654680 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 298/552] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:23 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:23.747181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:23.748077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:23.754605 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:23.755181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:23.755831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:23.756497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:23.757187 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:23.757852 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:23.801239 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:23.801760 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:23.802201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:23.802653 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:23.846383 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:23.854793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-17befa34-3814-4074-81e6-423cc203f4a3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1331 microversion: 2.1 time: 0.112114 Aug 18 17:09:23.855650 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 255/553] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:23 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1331 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:24.675176 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:24.675889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:24.683093 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:24.683514 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:24.685439 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:24.685439 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:24.685439 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:24.685439 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:24.820344 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:24.827925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-49dcd8bd-0b1f-4104-b652-9b629487ebd6 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1549 microversion: 2.1 time: 0.156567 Aug 18 17:09:24.828500 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 299/554] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:24 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:24.848597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:24.849222 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:24.856332 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:24.856818 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:24.857257 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:24.857948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:24.858405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:24.858830 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:24.876055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:24.876761 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:24.883032 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:24.883620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:24.884056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:24.884755 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:24.885202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:24.885622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:24.918565 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:24.918965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:24.919403 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:24.919899 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:24.971834 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:24.980846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-904bcf34-93e9-4ad8-b7c6-2d1e89bcdbbb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1331 microversion: 2.1 time: 0.108735 Aug 18 17:09:24.981706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 300/555] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:24 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:24.993744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:25.001602 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f550c433-4b2c-4b6b-8ea9-d07c116f68e3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1549 microversion: 2.1 time: 0.156911 Aug 18 17:09:25.002174 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 256/556] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:24 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:25.022424 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:25.028052 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:25.028833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Searching by: {'deleted': False, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797'} {{(pid=121267) get_all /opt/stack/nova/nova/compute/api.py:3007}} Aug 18 17:09:25.035451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:25.035947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:25.036378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:25.037104 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:25.037559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:25.037989 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:25.133068 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.multi_cell_list [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121267) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 18 17:09:25.230582 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1dc8e3db-9ad7-4937-a16d-c2baa39237b9 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.212194 Aug 18 17:09:25.231101 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 301/557] 10.222.0.78 () {58 vars in 1125 bytes} [Thu Aug 18 17:09:25 2022] GET /compute/v2.1/servers => generated 343 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:25.242961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:25.244279 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:25.250702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:25.251188 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:25.251650 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:25.252361 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:25.252822 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:25.253250 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:25.389909 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:25.398288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-690a73bc-11fa-47ce-ada4-494fe594b723 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1549 microversion: 2.1 time: 0.159728 Aug 18 17:09:25.398876 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 257/558] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:25 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:26.000719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:26.002144 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:26.011086 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:26.011958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:26.017875 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:26.019004 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:26.019718 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:26.020380 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:26.059186 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:26.060163 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:26.061627 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:26.062267 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:26.120561 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:26.135484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6749614f-4cae-48e8-bfa6-ebb0dbb67c04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 200 len: 1331 microversion: 2.1 time: 0.138222 Aug 18 17:09:26.136076 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 302/559] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:25 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 1331 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:26.931777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:26.934021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:26.941923 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:26.942416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:26.942884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:26.943646 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:26.944137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:26.944559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:26.968245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lazy-loading 'flavor' on Instance uuid 10ee2546-05c3-461e-bbc0-64cb39d936f7 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:09:27.162188 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:27.164637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:27.170146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:27.171315 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:27.171877 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:27.172659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:27.173193 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:27.173688 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:27.192177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 HTTP/1.1 Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:09:27.193934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:09:27.195218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': 'e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989'} Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:09:27.195929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:09:27.197050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:27.198172 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:09:27.198172 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3aebde6e-531d-48a3-acd7-c557ce3b526d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 404 len: 111 microversion: 2.1 time: 0.042828 Aug 18 17:09:27.198172 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 303/560] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:27 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:09:27.217891 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e1431688-ded7-47ee-9ee8-18532eb13e6e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '.version_select at 0x7ff5b4e6f4c0>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:27.295852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e1431688-ded7-47ee-9ee8-18532eb13e6e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355014340" status: 202 len: 0 microversion: 2.1 time: 0.094701 Aug 18 17:09:27.296442 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 304/561] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Aug 18 17:09:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1355014340 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 17:09:27.328410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a8d95faf-db16-45cd-886a-cc20c67fd4f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/action" status: 200 len: 32 microversion: 2.1 time: 0.401256 Aug 18 17:09:27.332416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 258/562] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:09:26 2022] POST /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/action => generated 32 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:09:27.332555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f48f7b9a-0505-457c-bf52-d3c5ee1d257f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fb38cdc-7668-445d-b3bb-272e214bda0d"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:27.332831 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f48f7b9a-0505-457c-bf52-d3c5ee1d257f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:27.341508 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f48f7b9a-0505-457c-bf52-d3c5ee1d257f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:27.342001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f48f7b9a-0505-457c-bf52-d3c5ee1d257f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:27.342319 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:27.342451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f48f7b9a-0505-457c-bf52-d3c5ee1d257f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:27.343168 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f48f7b9a-0505-457c-bf52-d3c5ee1d257f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:27.343641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f48f7b9a-0505-457c-bf52-d3c5ee1d257f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:27.343795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:27.344052 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f48f7b9a-0505-457c-bf52-d3c5ee1d257f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:27.354180 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:27.354978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:27.355403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:27.356153 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:27.356594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:27.357015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:27.623534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:27.632013 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-345d8d4e-96a7-46a1-b814-0892dd766324 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.295036 Aug 18 17:09:27.632599 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 259/563] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:27 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:28.094286 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f48f7b9a-0505-457c-bf52-d3c5ee1d257f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "POST /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.767621 Aug 18 17:09:28.094974 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 305/564] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:09:27 2022] POST /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments => generated 194 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:09:28.522541 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c844a665-fc46-45f2-9246-92f1d4dbae50 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: .version_select at 0x7ff5b4e4f9d0>, body: {"keypair": {"name": "tempest-keypair-1240512152", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRWqEe74HGVaAWmvjg8EXUeCVMdM2gLzNLAIqSlkjtnEazlKM3oWruxdE4dZXyQ/fiz3Ec5EBL/SVi5tQGhbZeJ6hIqthxC+2aNEhLSTsjrDoKaDEPUrn+rlZ579o8B5Q=="}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:28.528917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:28.539401 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-c844a665-fc46-45f2-9246-92f1d4dbae50 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for project 4eececcd804446e49078038ab362b235. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:09:28.543974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-c844a665-fc46-45f2-9246-92f1d4dbae50 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for user 1fec6bdfe9ee4e839efaf7a1c083c31d and project 4eececcd804446e49078038ab362b235. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:09:28.644798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c844a665-fc46-45f2-9246-92f1d4dbae50 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.126052 Aug 18 17:09:28.645347 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 260/565] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:09:28 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:28.655446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:28.656173 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:28.663413 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:28.663939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:28.664599 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:28.665989 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:28.666447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:28.666958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:28.806249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:28.809852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:28.814965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1562e835-ee8c-44d9-84aa-7ef29842edcb tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.164084 Aug 18 17:09:28.815574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 306/566] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:28 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:29.837661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:29.838354 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:29.845593 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:29.846687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:29.846687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:29.847292 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:29.847779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:29.848204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:30.038707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:30.047497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-982b4174-99b7-497a-a652-09b9326cef9f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.214400 Aug 18 17:09:30.048258 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 261/567] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:29 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:31.068419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:31.069016 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:31.076897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:31.077404 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:31.077833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:31.078524 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:31.078974 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:31.079389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:31.090259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2074647372", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c53d22-e6a6-4bb0-95db-6f41b7bca33b"}], "security_groups": [{"name": "tempest-securitygroup--1102724725"}], "key_name": "tempest-keypair-1240512152", "user_data": "}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:31.211227 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] validate_networks() for [('93c53d22-e6a6-4bb0-95db-6f41b7bca33b', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:09:31.226556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:31.235756 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-445b25f0-0fc6-44a3-a43a-313e20f5f0b8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.170790 Aug 18 17:09:31.243423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 307/568] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:31 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:31.616973 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:09:31.617403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:09:31.617945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:09:31.618359 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:09:31.619347 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:09:31.628609 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:31.629138 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:31.629583 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:31.630313 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:31.630773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:31.631201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:31.638034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:31.648838 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for project 4eececcd804446e49078038ab362b235. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:09:31.653806 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for user 1fec6bdfe9ee4e839efaf7a1c083c31d and project 4eececcd804446e49078038ab362b235. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:09:31.667052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:09:31.669461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:09:31.811290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-08d179d3-f982-4d77-8b3a-28b085b73f11 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.725265 Aug 18 17:09:31.812267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 262/569] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:09:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 727 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:09:31.823017 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-377c317d-7532-4528-8055-7d278ba69c23 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:31.823651 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-377c317d-7532-4528-8055-7d278ba69c23 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:31.879480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-377c317d-7532-4528-8055-7d278ba69c23 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:31.887018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-377c317d-7532-4528-8055-7d278ba69c23 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1242 microversion: 2.1 time: 0.067695 Aug 18 17:09:31.887701 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 308/570] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:31 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:32.258206 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:32.258820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:32.270649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:32.271147 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:32.271701 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:32.272463 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:32.272917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:32.273370 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:32.421535 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:32.431297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-14ea4b2b-b61f-45b3-a1f9-b67c1eb66d7d tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.177085 Aug 18 17:09:32.431664 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 263/571] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:32 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:32.908650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:32.909285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:32.915745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:32.916235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:32.916672 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:32.917374 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:32.917832 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:32.918255 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:32.980490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:32.988220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-60107f30-82a3-4bf4-ad7f-6f8d7dbdd4dd tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1246 microversion: 2.1 time: 0.083586 Aug 18 17:09:32.988780 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 309/572] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:32 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:33.453687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:33.454498 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:33.463095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:33.463629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:33.464071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:33.464777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:33.465238 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:33.465666 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:33.605834 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:33.615840 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-17e1648b-64de-43f0-9500-fb2e66290cd7 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.166609 Aug 18 17:09:33.616556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 264/573] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:33 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:34.008042 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:34.008682 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:34.015115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:34.015558 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:34.015987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:34.016938 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:34.017387 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:34.017802 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:34.079526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:34.089543 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ccdefb19-8b5e-4961-a0c0-be5b99c3fa2f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1294 microversion: 2.1 time: 0.085325 Aug 18 17:09:34.090123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 310/574] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:34 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1294 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:34.638123 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:34.638764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:34.645535 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:34.646015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:34.646454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:34.647144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:34.647644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:34.648073 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:34.789420 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:34.797627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fe2784b3-79f3-4403-ae14-5ffcad395646 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.163852 Aug 18 17:09:34.798192 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 265/575] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:34 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:35.111694 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:35.112547 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:35.115082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:35.120721 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:35.121564 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:35.122003 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:35.122704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:35.123158 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:35.123654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:35.191646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:35.199151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-015d5809-f0c2-4eee-88ae-311690b067ee tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1302 microversion: 2.1 time: 0.092315 Aug 18 17:09:35.199750 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 311/576] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:35 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1302 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:35.818517 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:35.819218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:35.828409 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:35.829044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:35.829634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:35.830386 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:35.830958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:35.831281 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:36.202724 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:36.213052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ed8c1029-566e-43fd-ba36-e12c7ee9bfb5 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.397995 Aug 18 17:09:36.213635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 266/577] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:35 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:36.232670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:36.233315 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:36.239947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:36.240431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:36.240858 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:36.241548 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:36.241996 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:36.242558 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:36.306679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:36.314782 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-64941ed5-7b05-48d0-8ff8-e68028c0106c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1300 microversion: 2.1 time: 0.086556 Aug 18 17:09:36.315684 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 312/578] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:36 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1300 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:36.795498 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:36.801037 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:36.802428 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:36.802926 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:36.803368 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:36.804103 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:36.804565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:36.804997 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:36.995288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:37.004087 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-77dcc960-fc4b-40cd-a7ca-761e306cb21b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1595 microversion: 2.1 time: 0.214179 Aug 18 17:09:37.004601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 267/579] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:36 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1595 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:37.234682 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:37.235462 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:37.241919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:37.242477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:37.243018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:37.243761 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:37.244209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:37.244623 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:37.336456 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:37.337067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:37.344761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:37.345262 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:37.345701 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:37.346414 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:37.346870 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:37.347495 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:37.485510 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:37.497160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-352c227c-7096-44d4-9ac5-c6bbb9470fdc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.266313 Aug 18 17:09:37.507862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 313/580] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:37 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:37.511902 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:37.520453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b649ffb3-7c0b-467b-8816-b96279d685af tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1368 microversion: 2.1 time: 0.187692 Aug 18 17:09:37.520955 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 268/581] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:37 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:37.811930 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-147872e9-8bfb-4939-a504-4b26d79d44db req-c3fb3d1f-8204-4f7c-a385-e073217bd6c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da756d85-46a8-4afd-bfbc-4e20051f6d10", "tag": "c333bfe5-da42-42cd-bf47-8e1f436f482b"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:37.827254 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-147872e9-8bfb-4939-a504-4b26d79d44db req-c3fb3d1f-8204-4f7c-a385-e073217bd6c4 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:37.828307 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-147872e9-8bfb-4939-a504-4b26d79d44db req-c3fb3d1f-8204-4f7c-a385-e073217bd6c4 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:37.828987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-147872e9-8bfb-4939-a504-4b26d79d44db req-c3fb3d1f-8204-4f7c-a385-e073217bd6c4 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:37.844207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-147872e9-8bfb-4939-a504-4b26d79d44db req-c3fb3d1f-8204-4f7c-a385-e073217bd6c4 service nova] Creating event network-changed:c333bfe5-da42-42cd-bf47-8e1f436f482b for instance da756d85-46a8-4afd-bfbc-4e20051f6d10 on hv-cinder-85367 Aug 18 17:09:37.851197 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-147872e9-8bfb-4939-a504-4b26d79d44db req-c3fb3d1f-8204-4f7c-a385-e073217bd6c4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047531 Aug 18 17:09:37.852182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 314/582] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:38.518553 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:38.522019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:38.526212 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:38.526690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:38.527120 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:38.527829 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:38.528279 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:38.528697 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:38.541869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:38.542590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:38.549039 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:38.553533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:38.553533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:38.553533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:38.553533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:38.553905 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:38.739024 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:38.748170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ff5474aa-fb0b-482c-a565-921ee9ee6275 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.233693 Aug 18 17:09:38.759876 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 269/583] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:38 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:39.048247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:39.056442 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b44cb2a4-842a-4d51-959b-b7492020c7bb tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1368 microversion: 2.1 time: 0.519130 Aug 18 17:09:39.056916 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 315/584] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:38 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1368 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:39.491927 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-9df4c329-15a6-45b5-b3e7-62bd4dca5ad2 req-2d4cb8ba-8f37-4743-92ba-0759cb015229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c79a7d-abff-4d4f-aecc-309441c5e3bc", "tag": "2ee00035-edc8-4a51-89b1-4dc0e2c5a468"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:39.502158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-9df4c329-15a6-45b5-b3e7-62bd4dca5ad2 req-2d4cb8ba-8f37-4743-92ba-0759cb015229 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:39.502640 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-9df4c329-15a6-45b5-b3e7-62bd4dca5ad2 req-2d4cb8ba-8f37-4743-92ba-0759cb015229 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:39.503068 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-9df4c329-15a6-45b5-b3e7-62bd4dca5ad2 req-2d4cb8ba-8f37-4743-92ba-0759cb015229 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:39.515057 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-9df4c329-15a6-45b5-b3e7-62bd4dca5ad2 req-2d4cb8ba-8f37-4743-92ba-0759cb015229 service nova] Creating event network-changed:2ee00035-edc8-4a51-89b1-4dc0e2c5a468 for instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc on hv-cinder-85367 Aug 18 17:09:39.521178 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-9df4c329-15a6-45b5-b3e7-62bd4dca5ad2 req-2d4cb8ba-8f37-4743-92ba-0759cb015229 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032538 Aug 18 17:09:39.521860 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 270/585] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:39.770615 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:39.771251 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:39.778223 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:39.778712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:39.779150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:39.780069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:39.780704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:39.781569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:39.940811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:39.949376 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3420fba1-c0de-4bd6-808d-457c2f914c90 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.183460 Aug 18 17:09:39.950053 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 316/586] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:39 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:40.078472 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:40.079206 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:40.086232 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:40.086757 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:40.087756 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:40.088464 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:40.088922 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:40.089347 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:40.250095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:40.258275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d221f8b3-b77a-4568-9991-99b6150626ed tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1368 microversion: 2.1 time: 0.184488 Aug 18 17:09:40.258844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 271/587] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:40 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:40.971015 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:40.971651 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:40.979453 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:40.980227 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:40.980674 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:40.981403 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:40.981864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:40.982278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:41.139374 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:41.148184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ac3a07ff-e1f1-4925-a8ac-9e4f1be39fa3 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.180790 Aug 18 17:09:41.148814 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 317/588] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:40 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:41.282275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:41.282890 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:41.289646 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:41.290638 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:41.291119 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:41.291971 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:41.292423 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:41.292883 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:41.430960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:41.439243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-079c1254-d669-47d7-a231-fdb97a3caf87 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1368 microversion: 2.1 time: 0.160876 Aug 18 17:09:41.439838 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 272/589] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:41 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:42.038547 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-72043bd0-8b39-4fd0-aa6a-16d3d9e9c3a3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4900cdf4-699b-48b5-baa7-7510bb6b891d", "device": "/dev/sdb"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:42.041692 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-72043bd0-8b39-4fd0-aa6a-16d3d9e9c3a3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:42.043723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:42.049163 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72043bd0-8b39-4fd0-aa6a-16d3d9e9c3a3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.049638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72043bd0-8b39-4fd0-aa6a-16d3d9e9c3a3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.050115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72043bd0-8b39-4fd0-aa6a-16d3d9e9c3a3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:42.050775 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72043bd0-8b39-4fd0-aa6a-16d3d9e9c3a3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.051230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72043bd0-8b39-4fd0-aa6a-16d3d9e9c3a3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.051682 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-72043bd0-8b39-4fd0-aa6a-16d3d9e9c3a3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:42.170330 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:42.171031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:42.173159 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:42.174155 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=10 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:42.179470 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.180047 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.180554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:42.181452 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.181988 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.182482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:42.316472 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:42.325075 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f07d47ac-3b1f-47c4-9baa-edc8d8f05d33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.158550 Aug 18 17:09:42.325648 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 273/590] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:42 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:42.330573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-680064005"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:42.331338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:42.337899 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.344211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.344211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:42.344211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.344211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.344634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:42.485304 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.network.security_group_api [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Adding security group 3a082a5f-d965-424a-923f-393a462e2d5f to port 2ee00035-edc8-4a51-89b1-4dc0e2c5a468 Aug 18 17:09:42.888187 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-eafde59a-7814-46ae-b223-6bcddda6cb1b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "POST /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/action" status: 202 len: 0 microversion: 2.1 time: 0.561163 Aug 18 17:09:42.892323 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 274/591] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:09:42 2022] POST /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/action => generated 0 bytes in 566 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:09:42.899040 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:42.900241 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:42.902142 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-72043bd0-8b39-4fd0-aa6a-16d3d9e9c3a3 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "POST /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.868601 Aug 18 17:09:42.903203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 318/592] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:09:42 2022] POST /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:09:42.914646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:42.915256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.916325 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:42.916766 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.919091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:42.919960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.920555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.922735 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:42.931519 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.932294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.932932 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:42.933867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:42.934479 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:42.934902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:43.076250 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:43.085176 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-550f672c-bbdf-457d-a977-d75e00740338 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1368 microversion: 2.1 time: 0.190564 Aug 18 17:09:43.085176 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 275/593] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:42 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:43.090067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-bb673c35-9ee1-4383-ab2f-8868d316c78b req-2f80c048-b129-46a7-983f-e505b7df91dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c79a7d-abff-4d4f-aecc-309441c5e3bc", "tag": "2ee00035-edc8-4a51-89b1-4dc0e2c5a468"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:43.095158 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:43.106437 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1c2b9866-1d12-452f-96e3-6eb8d1be6de1 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1759 microversion: 2.1 time: 0.201854 Aug 18 17:09:43.107030 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 319/594] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:42 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1759 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:43.113495 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-bb673c35-9ee1-4383-ab2f-8868d316c78b req-2f80c048-b129-46a7-983f-e505b7df91dc service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:43.113982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-bb673c35-9ee1-4383-ab2f-8868d316c78b req-2f80c048-b129-46a7-983f-e505b7df91dc service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:43.114971 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-bb673c35-9ee1-4383-ab2f-8868d316c78b req-2f80c048-b129-46a7-983f-e505b7df91dc service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:43.127848 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-bb673c35-9ee1-4383-ab2f-8868d316c78b req-2f80c048-b129-46a7-983f-e505b7df91dc service nova] Creating event network-changed:2ee00035-edc8-4a51-89b1-4dc0e2c5a468 for instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc on hv-cinder-85367 Aug 18 17:09:43.132785 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-bb673c35-9ee1-4383-ab2f-8868d316c78b req-2f80c048-b129-46a7-983f-e505b7df91dc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046851 Aug 18 17:09:43.133383 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 276/595] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:43.346134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:43.346847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:43.354159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:43.354819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:43.355183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:43.355915 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:43.356375 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:43.359626 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:43.498578 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:43.507153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f9ff0d5c-bc7c-46bd-89cf-6bfd56015a93 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.164738 Aug 18 17:09:43.508723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 320/596] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:43 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:44.107533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:44.108320 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:44.115915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:44.116404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:44.116865 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:44.117625 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:44.118282 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:44.118707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:44.257429 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:44.265288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ed9eb513-9271-41a5-8127-2f0737a9bdb9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1368 microversion: 2.1 time: 0.162271 Aug 18 17:09:44.265867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 277/597] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:44 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:44.296456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-2b470057-a268-45b5-82de-82164e7f5239 req-47476a2d-dfee-45aa-a3b6-fe174afd7694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da756d85-46a8-4afd-bfbc-4e20051f6d10", "name": "network-vif-plugged", "status": "completed", "tag": "c333bfe5-da42-42cd-bf47-8e1f436f482b"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:44.309161 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-2b470057-a268-45b5-82de-82164e7f5239 req-47476a2d-dfee-45aa-a3b6-fe174afd7694 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:44.309642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-2b470057-a268-45b5-82de-82164e7f5239 req-47476a2d-dfee-45aa-a3b6-fe174afd7694 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:44.310064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-2b470057-a268-45b5-82de-82164e7f5239 req-47476a2d-dfee-45aa-a3b6-fe174afd7694 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:44.322720 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-2b470057-a268-45b5-82de-82164e7f5239 req-47476a2d-dfee-45aa-a3b6-fe174afd7694 service nova] Creating event network-vif-plugged:c333bfe5-da42-42cd-bf47-8e1f436f482b for instance da756d85-46a8-4afd-bfbc-4e20051f6d10 on hv-cinder-85367 Aug 18 17:09:44.327554 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-2b470057-a268-45b5-82de-82164e7f5239 req-47476a2d-dfee-45aa-a3b6-fe174afd7694 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034841 Aug 18 17:09:44.328155 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 321/598] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:44.529542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:44.530084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:44.536184 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:44.536674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:44.537111 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:44.537809 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:44.538266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:44.538696 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:44.668803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:44.677209 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-cc7207eb-a97a-4eac-9e4a-d7c554a7e45c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.151525 Aug 18 17:09:44.677788 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 278/599] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:44 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:45.293653 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:45.294260 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:45.301441 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:45.302048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:45.302446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:45.303063 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:45.303560 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:45.303985 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:45.435525 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:45.443143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-eeedcf6b-ccaa-4ac5-9506-8500f21203f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1368 microversion: 2.1 time: 0.154353 Aug 18 17:09:45.443750 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 322/600] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:45 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:45.698172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:45.698780 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:45.705452 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:45.705929 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:45.706359 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:45.707065 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:45.707550 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:45.707968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:45.838906 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:45.847062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-89c5f338-6653-4cec-a932-0753f0765ffd tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1736 microversion: 2.1 time: 0.152795 Aug 18 17:09:45.847649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 279/601] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:45 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:46.464622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:46.465227 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:46.471772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:46.472248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:46.472676 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:46.473369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:46.473817 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:46.474239 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:46.604985 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:46.612582 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8f6c6fe9-d305-46b5-96c4-3e49dce2b0d6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1368 microversion: 2.1 time: 0.152701 Aug 18 17:09:46.613149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 323/602] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:46 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:46.869168 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:46.869861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:46.876293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:46.876773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:46.877201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:46.877887 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:46.878335 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:46.878752 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:47.005435 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:47.014460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1b894ec7-f6d3-470e-96a5-1e516cde158f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1716 microversion: 2.1 time: 0.149647 Aug 18 17:09:47.015033 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 280/603] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:46 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1716 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:47.128808 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:47.129300 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:47.135649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:47.137440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:47.137440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:47.137440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:47.137952 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:47.138177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:47.197777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:47.263447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] HTTP exception thrown: Cannot 'detach_volume' instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 while it is in vm_state rescued Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Request method failure captured: Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments/b2612312-4a00-402b-862e-7c85ad43ed39 HTTP/1.1 Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFhH2yYX7xcdPCDSwWtSZHmnOE-W47U9s3JNZq7u1jv_RuXGKvu0b-fH9zNDVd5do94K1mzWLrv10OXD1Mlrr-WZ-r-XBg5yRUddndOLc3xkh9Q0nGpQt2Lqry8y5fv1tlt3ceTLX_8FOb6Js9mKZropmkuIjqsUIAy79tdGEJS88U Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:09:47.265060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ccc5c89023ff476ca3b85680f56f8899", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: a3bc033664c445f78b9d67440876c19d Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:09:47.266869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Cannot 'detach_volume' instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 while it is in vm_state rescued Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'server_id': '10ee2546-05c3-461e-bbc0-64cb39d936f7', 'id': 'b2612312-4a00-402b-862e-7c85ad43ed39'} Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:09:47.267719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 while it is in vm_state rescued Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 while it is in vm_state rescued Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:09:47.271606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Returning 409 to user: Cannot 'detach_volume' instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 while it is in vm_state rescued {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:09:47.272812 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fc4a0c8b-7ba2-4b97-8f34-091d7b198635 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "DELETE /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments/b2612312-4a00-402b-862e-7c85ad43ed39" status: 409 len: 152 microversion: 2.1 time: 0.142394 Aug 18 17:09:47.272812 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 324/604] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:09:47 2022] DELETE /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments/b2612312-4a00-402b-862e-7c85ad43ed39 => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 18 17:09:47.276759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f2724848-207b-46a0-a84e-6f062880f5cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:47.277270 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f2724848-207b-46a0-a84e-6f062880f5cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:47.283694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2724848-207b-46a0-a84e-6f062880f5cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:47.284174 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2724848-207b-46a0-a84e-6f062880f5cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:47.284608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2724848-207b-46a0-a84e-6f062880f5cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:47.285295 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2724848-207b-46a0-a84e-6f062880f5cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:47.285771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2724848-207b-46a0-a84e-6f062880f5cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:47.286244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2724848-207b-46a0-a84e-6f062880f5cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:47.290512 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=100 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:47.492091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f2724848-207b-46a0-a84e-6f062880f5cf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "POST /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/action" status: 202 len: 0 microversion: 2.1 time: 0.219111 Aug 18 17:09:47.492755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 281/605] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:09:47 2022] POST /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/action => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:09:47.501473 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:47.502090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:47.512759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:47.514668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:47.514668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:47.514668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:47.514936 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:47.515645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:47.634041 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:47.634747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:47.642134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:47.642662 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:47.643904 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:47.644613 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:47.645076 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:47.645559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:47.652377 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:47.661753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-dc510b96-4a27-44dc-a454-bb73e43534c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1724 microversion: 2.1 time: 0.164167 Aug 18 17:09:47.662329 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 325/606] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:47 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:47.784982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:47.792907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2761cfb2-ee82-4d17-9682-8ab3ddb3e0f4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1368 microversion: 2.1 time: 0.163087 Aug 18 17:09:47.793475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 282/607] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:47 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:48.683826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:48.684351 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:48.690776 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:48.691265 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:48.691737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:48.692448 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:48.692924 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:48.693371 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:48.813966 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:48.814574 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:48.820628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:48.821630 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:48.822067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:48.822759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:48.823207 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:48.823654 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:48.831796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:48.840875 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3ba09feb-2999-4fea-a327-70b3599ea893 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1724 microversion: 2.1 time: 0.160985 Aug 18 17:09:48.841454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 326/608] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:48 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:48.957014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:48.964809 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e46d9f42-9dbb-4fca-aaea-c0fbb2e9f1d7 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1558 microversion: 2.1 time: 0.155306 Aug 18 17:09:48.965379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 283/609] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:48 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:48.984724 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ef071ecb-fcd0-4f98-85f1-933595789517 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:48.985221 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ef071ecb-fcd0-4f98-85f1-933595789517 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:48.991401 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef071ecb-fcd0-4f98-85f1-933595789517 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:48.991917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef071ecb-fcd0-4f98-85f1-933595789517 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:48.992353 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef071ecb-fcd0-4f98-85f1-933595789517 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:48.993628 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef071ecb-fcd0-4f98-85f1-933595789517 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:48.994091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef071ecb-fcd0-4f98-85f1-933595789517 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:48.994515 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef071ecb-fcd0-4f98-85f1-933595789517 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:49.073075 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ef071ecb-fcd0-4f98-85f1-933595789517 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092181 Aug 18 17:09:49.073672 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 327/610] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Aug 18 17:09:48 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:49.862563 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:49.863209 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:49.870465 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:49.870954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:49.871392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:49.872108 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:49.872565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:49.872990 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:50.002666 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:50.011757 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5a9ff34d-3868-4489-830d-0857c8b36e57 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1724 microversion: 2.1 time: 0.152961 Aug 18 17:09:50.012265 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 284/611] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:49 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:50.101454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-45331561-4d91-4a0b-95b1-2dd75b2cd332 req-68766f52-c40e-4b10-8a73-76e1569f6e5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da756d85-46a8-4afd-bfbc-4e20051f6d10", "tag": "c333bfe5-da42-42cd-bf47-8e1f436f482b"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:50.111858 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-45331561-4d91-4a0b-95b1-2dd75b2cd332 req-68766f52-c40e-4b10-8a73-76e1569f6e5f service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:50.112336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-45331561-4d91-4a0b-95b1-2dd75b2cd332 req-68766f52-c40e-4b10-8a73-76e1569f6e5f service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:50.112767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-45331561-4d91-4a0b-95b1-2dd75b2cd332 req-68766f52-c40e-4b10-8a73-76e1569f6e5f service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:50.124841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-45331561-4d91-4a0b-95b1-2dd75b2cd332 req-68766f52-c40e-4b10-8a73-76e1569f6e5f service nova] Creating event network-changed:c333bfe5-da42-42cd-bf47-8e1f436f482b for instance da756d85-46a8-4afd-bfbc-4e20051f6d10 on hv-cinder-85367 Aug 18 17:09:50.131536 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-45331561-4d91-4a0b-95b1-2dd75b2cd332 req-68766f52-c40e-4b10-8a73-76e1569f6e5f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034476 Aug 18 17:09:50.132286 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 328/612] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:51.033442 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:51.034078 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:51.040503 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:51.040998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:51.041434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:51.042149 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:51.042608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:51.043137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:51.200017 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:51.212481 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7cb56be5-c86c-43e7-bd31-87e7a4b6f08c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1724 microversion: 2.1 time: 0.183498 Aug 18 17:09:51.213065 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 285/613] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:51 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:09:52.235484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:52.236188 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:52.242351 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:52.242838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:52.243281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:52.244008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:52.244464 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:52.244915 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:52.385464 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:09:52.393877 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-49e27a3e-0441-4a27-9707-5aa1fc75cf33 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1730 microversion: 2.1 time: 0.163216 Aug 18 17:09:52.394497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 329/614] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:09:52 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:09:52.415135 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2445a762-c6c6-45d0-ad04-a670199632bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:09:52.415692 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2445a762-c6c6-45d0-ad04-a670199632bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:09:52.422127 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2445a762-c6c6-45d0-ad04-a670199632bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:52.422789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2445a762-c6c6-45d0-ad04-a670199632bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:52.425961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2445a762-c6c6-45d0-ad04-a670199632bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:52.425961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2445a762-c6c6-45d0-ad04-a670199632bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:52.425961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2445a762-c6c6-45d0-ad04-a670199632bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:52.425961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2445a762-c6c6-45d0-ad04-a670199632bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:52.500683 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2445a762-c6c6-45d0-ad04-a670199632bf tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089417 Aug 18 17:09:52.501486 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 286/615] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Aug 18 17:09:52 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:09:54.039176 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-69e4150d-ae0b-498e-9b15-80a88d9da7e9 req-4a421388-f8bd-4c2e-90ef-99cb746d7567 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ee2546-05c3-461e-bbc0-64cb39d936f7", "tag": "4be84b1f-a309-40e8-8519-3e746d6a87a8"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:54.054947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:09:54.058014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-69e4150d-ae0b-498e-9b15-80a88d9da7e9 req-4a421388-f8bd-4c2e-90ef-99cb746d7567 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:54.068593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-69e4150d-ae0b-498e-9b15-80a88d9da7e9 req-4a421388-f8bd-4c2e-90ef-99cb746d7567 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:54.068593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-69e4150d-ae0b-498e-9b15-80a88d9da7e9 req-4a421388-f8bd-4c2e-90ef-99cb746d7567 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:54.072269 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-69e4150d-ae0b-498e-9b15-80a88d9da7e9 req-4a421388-f8bd-4c2e-90ef-99cb746d7567 service nova] Creating event network-changed:4be84b1f-a309-40e8-8519-3e746d6a87a8 for instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 on hv-cinder-85367 Aug 18 17:09:54.078381 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-69e4150d-ae0b-498e-9b15-80a88d9da7e9 req-4a421388-f8bd-4c2e-90ef-99cb746d7567 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042665 Aug 18 17:09:54.079116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 330/616] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:09:56.094440 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-5fe8a0a0-c7ce-4665-b9a4-38f63c252418 req-a8f3e299-6f38-41b4-bc9a-c2d77800f0b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ee2546-05c3-461e-bbc0-64cb39d936f7", "tag": "4be84b1f-a309-40e8-8519-3e746d6a87a8"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:09:56.104415 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5fe8a0a0-c7ce-4665-b9a4-38f63c252418 req-a8f3e299-6f38-41b4-bc9a-c2d77800f0b8 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:09:56.104891 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5fe8a0a0-c7ce-4665-b9a4-38f63c252418 req-a8f3e299-6f38-41b4-bc9a-c2d77800f0b8 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:09:56.105317 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5fe8a0a0-c7ce-4665-b9a4-38f63c252418 req-a8f3e299-6f38-41b4-bc9a-c2d77800f0b8 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:09:56.116464 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-5fe8a0a0-c7ce-4665-b9a4-38f63c252418 req-a8f3e299-6f38-41b4-bc9a-c2d77800f0b8 service nova] Creating event network-changed:4be84b1f-a309-40e8-8519-3e746d6a87a8 for instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 on hv-cinder-85367 Aug 18 17:09:56.122370 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-5fe8a0a0-c7ce-4665-b9a4-38f63c252418 req-a8f3e299-6f38-41b4-bc9a-c2d77800f0b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032241 Aug 18 17:09:56.122947 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 287/617] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:09:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:10.771091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:10.771704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:10.774630 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=28 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:10.779860 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:10.780350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:10.780791 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:10.781492 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:10.781951 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:10.782434 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:10.863129 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lazy-loading 'services' on Instance uuid c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:10:11.105059 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a083a3c1-0880-4128-a168-297bf7cd4918 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4/os-volume_attachments/4900cdf4-699b-48b5-baa7-7510bb6b891d" status: 202 len: 0 microversion: 2.1 time: 0.338226 Aug 18 17:10:11.105652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 331/618] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:10:10 2022] DELETE /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4/os-volume_attachments/4900cdf4-699b-48b5-baa7-7510bb6b891d => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:10:13.286628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:13.287240 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:13.289982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:13.290635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:13.299702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:13.299702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:13.299702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:13.299702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:13.300299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:13.300299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:13.326819 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:10:13.673409 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4d28016f-88e6-4b52-9f9b-31acbd43ac6f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 204 len: 0 microversion: 2.1 time: 0.390862 Aug 18 17:10:13.674027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 288/619] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:10:13 2022] DELETE /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:10:13.683457 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:13.684168 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:13.692179 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:13.692658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:13.693115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:13.693901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:13.694346 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:13.694760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:13.828029 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:13.836054 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7404755f-0235-455b-8329-09e48ffc406d tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1513 microversion: 2.1 time: 0.157507 Aug 18 17:10:13.836622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 332/620] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:13 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:14.857201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:14.858401 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:14.864367 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:14.864847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:14.865279 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:14.866050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:14.866460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:14.866847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:15.021679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:15.033712 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-88cd7090-f53a-4937-a2d1-db71a0486e92 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1513 microversion: 2.1 time: 0.180496 Aug 18 17:10:15.034589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 289/621] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:14 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:15.323015 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f8c626c5-0a91-4463-8eff-984730a5f733 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:15.323593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f8c626c5-0a91-4463-8eff-984730a5f733 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:15.330143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8c626c5-0a91-4463-8eff-984730a5f733 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:15.330635 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8c626c5-0a91-4463-8eff-984730a5f733 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:15.331082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8c626c5-0a91-4463-8eff-984730a5f733 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:15.331819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8c626c5-0a91-4463-8eff-984730a5f733 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:15.332278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8c626c5-0a91-4463-8eff-984730a5f733 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:15.332741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f8c626c5-0a91-4463-8eff-984730a5f733 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:15.363671 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f8c626c5-0a91-4463-8eff-984730a5f733 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments/486425b0-aa75-4c8c-a429-1ebe6f1ecbb4" status: 200 len: 194 microversion: 2.20 time: 0.044453 Aug 18 17:10:15.364263 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 333/622] 10.222.0.78 () {60 vars in 1454 bytes} [Thu Aug 18 17:10:15 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments/486425b0-aa75-4c8c-a429-1ebe6f1ecbb4 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:10:15.432758 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:15.433277 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:15.439520 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:15.440013 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:15.440580 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:15.441280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:15.441738 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:15.442163 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:15.522770 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lazy-loading 'services' on Instance uuid 68e481aa-bf5a-436b-baca-f5c8b88de401 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:10:15.721991 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-78971452-6980-4a8d-85b8-9ce8553b8a09 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "DELETE /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments/486425b0-aa75-4c8c-a429-1ebe6f1ecbb4" status: 202 len: 0 microversion: 2.20 time: 0.293106 Aug 18 17:10:15.722756 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 290/623] 10.222.0.78 () {60 vars in 1457 bytes} [Thu Aug 18 17:10:15 2022] DELETE /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments/486425b0-aa75-4c8c-a429-1ebe6f1ecbb4 => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:10:15.731281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a0bad242-ead4-4fce-ae5c-6aaa4fa1f60f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:15.734090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a0bad242-ead4-4fce-ae5c-6aaa4fa1f60f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:15.739862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0bad242-ead4-4fce-ae5c-6aaa4fa1f60f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:15.740350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0bad242-ead4-4fce-ae5c-6aaa4fa1f60f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:15.746018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0bad242-ead4-4fce-ae5c-6aaa4fa1f60f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:15.746018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0bad242-ead4-4fce-ae5c-6aaa4fa1f60f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:15.746018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0bad242-ead4-4fce-ae5c-6aaa4fa1f60f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:15.746018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0bad242-ead4-4fce-ae5c-6aaa4fa1f60f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:15.776055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a0bad242-ead4-4fce-ae5c-6aaa4fa1f60f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048792 Aug 18 17:10:15.776632 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 334/624] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Aug 18 17:10:15 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:10:16.056062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:16.056764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:16.063543 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:16.064036 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:16.064480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:16.065176 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:16.065637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:16.066582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:16.269162 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-2b0754a7-b32f-4ee5-9012-ea6b909dbcf7 req-8b10c1e5-3095-45e4-b147-ce4e4c7b9265 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9d8d9fd-f9dc-4547-8a84-228a57dce5e4", "name": "network-vif-deleted", "tag": "0c77e253-eb7e-4f3b-a573-87f2912d98d0"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:16.280626 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-2b0754a7-b32f-4ee5-9012-ea6b909dbcf7 req-8b10c1e5-3095-45e4-b147-ce4e4c7b9265 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:16.281203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-2b0754a7-b32f-4ee5-9012-ea6b909dbcf7 req-8b10c1e5-3095-45e4-b147-ce4e4c7b9265 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:16.281978 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-2b0754a7-b32f-4ee5-9012-ea6b909dbcf7 req-8b10c1e5-3095-45e4-b147-ce4e4c7b9265 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:16.295910 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-2b0754a7-b32f-4ee5-9012-ea6b909dbcf7 req-8b10c1e5-3095-45e4-b147-ce4e4c7b9265 service nova] Creating event network-vif-deleted:0c77e253-eb7e-4f3b-a573-87f2912d98d0 for instance c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 on hv-cinder-85367 Aug 18 17:10:16.300450 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:16.302735 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-2b0754a7-b32f-4ee5-9012-ea6b909dbcf7 req-8b10c1e5-3095-45e4-b147-ce4e4c7b9265 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039341 Aug 18 17:10:16.303593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 335/625] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:10:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:10:16.306322 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-59716421-4aa2-4507-b229-6fd84f3f4742 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 200 len: 1513 microversion: 2.1 time: 0.255814 Aug 18 17:10:16.306917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 291/626] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:16 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:16.791035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ff251c0f-29c7-4f2d-b33a-1caf433e85ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:16.793324 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ff251c0f-29c7-4f2d-b33a-1caf433e85ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:16.800612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ff251c0f-29c7-4f2d-b33a-1caf433e85ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:16.801102 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ff251c0f-29c7-4f2d-b33a-1caf433e85ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:16.801542 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ff251c0f-29c7-4f2d-b33a-1caf433e85ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:16.802243 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ff251c0f-29c7-4f2d-b33a-1caf433e85ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:16.802832 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ff251c0f-29c7-4f2d-b33a-1caf433e85ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:16.803276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ff251c0f-29c7-4f2d-b33a-1caf433e85ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:16.836554 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ff251c0f-29c7-4f2d-b33a-1caf433e85ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051225 Aug 18 17:10:16.837121 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 336/627] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Aug 18 17:10:16 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:10:17.326558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:17.327098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: c9d8d9fd-f9dc-4547-8a84-228a57dce5e4] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:17.333565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:17.334046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:17.334487 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:17.335173 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:17.335655 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:17.336081 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:17.350756 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] HTTP exception thrown: Instance c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 could not be found. Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Request method failure captured: Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 HTTP/1.1 Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nIind8RO-1kRzAOuSQDNEZeleO0H1-mbUfLfhRj4Yb_VE83nq0WKLBckfZFbVff8OjycjBCX0qkQ_kV--CftyvUgGr38ELqz02p1DC7ay9BeIR_8a0HA1m4ax17fKZMNiAat8a8aVc4pwB-6kXcCr0xaOAD4LrLf93vUf0SBwc2-lY Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 50036d9fc240431fbcd0b75ed17248fd Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesSnapshotTestJSON-346599018 Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:10:17.353097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/50036d9fc240431fbcd0b75ed17248fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/50036d9fc240431fbcd0b75ed17248fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/50036d9fc240431fbcd0b75ed17248fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_50036d9fc240431fbcd0b75ed17248fd", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesSnapshotTestJSON-346599018 Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 50036d9fc240431fbcd0b75ed17248fd Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-346599018 Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesSnapshotTestJSON-346599018-project Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: ff492aa3ff514be8a7bfebdf8241e79a Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesSnapshotTestJSON-346599018-project Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 could not be found. Aug 18 17:10:17.354649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': 'c9d8d9fd-f9dc-4547-8a84-228a57dce5e4'} Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 could not be found. Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:10:17.355482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 could not be found. Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 could not be found. Aug 18 17:10:17.356998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:17.359413 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Returning 404 to user: Instance c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:10:17.359413 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-364fd519-11f6-4034-9411-dfe006859c19 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4" status: 404 len: 111 microversion: 2.1 time: 0.031977 Aug 18 17:10:17.359413 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 292/628] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:17 2022] GET /compute/v2.1/servers/c9d8d9fd-f9dc-4547-8a84-228a57dce5e4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:10:17.848533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f701989b-c639-4ae3-b8e7-c22b106dccd4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:17.851018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f701989b-c639-4ae3-b8e7-c22b106dccd4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:17.858051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f701989b-c639-4ae3-b8e7-c22b106dccd4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:17.858533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f701989b-c639-4ae3-b8e7-c22b106dccd4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:17.858963 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f701989b-c639-4ae3-b8e7-c22b106dccd4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:17.859760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f701989b-c639-4ae3-b8e7-c22b106dccd4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:17.860210 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f701989b-c639-4ae3-b8e7-c22b106dccd4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:17.860631 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f701989b-c639-4ae3-b8e7-c22b106dccd4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:17.890075 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f701989b-c639-4ae3-b8e7-c22b106dccd4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045542 Aug 18 17:10:17.890926 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 337/629] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Aug 18 17:10:17 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:17.972753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:17.973168 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:17.981477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:17.981964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:17.982434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:17.983769 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:17.984317 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:17.984746 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:18.012025 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:10:18.333909 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9023be21-47d7-40c0-b9ac-4853a33a629b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "DELETE /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 204 len: 0 microversion: 2.20 time: 0.364863 Aug 18 17:10:18.334682 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 293/630] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Aug 18 17:10:17 2022] DELETE /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 17:10:18.342607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:18.343312 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:18.350486 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:18.350974 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:18.351827 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:18.353885 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:18.353885 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:18.354098 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:18.491976 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:18.497606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:18.499115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:18.500421 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8415a1f3-c2e7-46c1-bdf7-f8df7233d47d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.161686 Aug 18 17:10:18.500984 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 338/631] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:18 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:19.526143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:19.526842 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:19.533806 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:19.560517 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:19.560517 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:19.560517 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:19.560517 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:19.560976 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:19.664958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:19.673684 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:19.675155 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:19.676350 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0ab3d529-604f-4e19-b8dc-220cd639c0e4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.154568 Aug 18 17:10:19.676898 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 294/632] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:19 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:20.698222 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:20.698835 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:20.705514 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:20.706005 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:20.706443 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:20.707144 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:20.707636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:20.708063 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:20.837687 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:20.846391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:20.847941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:20.849127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2102d658-eef5-4800-a0cb-cfd471a54432 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.154866 Aug 18 17:10:20.849686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 339/633] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:20 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:21.873484 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:21.874203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:21.881261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:21.881760 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:21.882207 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:21.882945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:21.883406 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:21.884006 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:22.141843 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:22.150309 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:22.151838 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:22.153004 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-270e1e29-06a7-4eca-a47c-a753678a3f6f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.284472 Aug 18 17:10:22.153565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 295/634] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:21 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:23.184237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:23.184845 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:23.191917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:23.192408 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:23.192846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:23.193549 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:23.194007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:23.194436 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:23.386950 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:23.398455 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:23.400014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:23.401207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4c196103-ab39-401b-befb-4cbd49b92a1b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1723 microversion: 2.20 time: 0.221014 Aug 18 17:10:23.401771 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 340/635] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:23 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:23.661783 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-b1fb59f8-f3bb-4001-91ee-4fd507277c88 req-2c927672-611e-416a-a161-8554f71b157f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "68e481aa-bf5a-436b-baca-f5c8b88de401", "name": "network-vif-deleted", "tag": "9d480631-4b24-43e0-8000-c7d4668399bb"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:23.672573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b1fb59f8-f3bb-4001-91ee-4fd507277c88 req-2c927672-611e-416a-a161-8554f71b157f service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:23.672960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b1fb59f8-f3bb-4001-91ee-4fd507277c88 req-2c927672-611e-416a-a161-8554f71b157f service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:23.673545 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b1fb59f8-f3bb-4001-91ee-4fd507277c88 req-2c927672-611e-416a-a161-8554f71b157f service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:23.685530 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-b1fb59f8-f3bb-4001-91ee-4fd507277c88 req-2c927672-611e-416a-a161-8554f71b157f service nova] Creating event network-vif-deleted:9d480631-4b24-43e0-8000-c7d4668399bb for instance 68e481aa-bf5a-436b-baca-f5c8b88de401 on hv-cinder-85367 Aug 18 17:10:23.690777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-b1fb59f8-f3bb-4001-91ee-4fd507277c88 req-2c927672-611e-416a-a161-8554f71b157f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033596 Aug 18 17:10:23.694949 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 296/636] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:10:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:24.424973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:24.428189 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:24.432212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:24.432695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:24.433122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:24.433812 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:24.434271 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:24.434674 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:24.474480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:24.474957 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:24.475383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:24.475849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lazy-loading 'fault' on Instance uuid 68e481aa-bf5a-436b-baca-f5c8b88de401 {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:10:24.522689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:24.537048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:24.539414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:24.540965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b0c09c1b-0723-4a68-b247-a2a7849d7572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1371 microversion: 2.20 time: 0.119843 Aug 18 17:10:24.541773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 341/637] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:24 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1371 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:25.564863 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:25.565556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:25.572498 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:25.572984 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:25.573425 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:25.574121 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:25.574580 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:25.575004 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:25.606060 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:25.606657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:25.607099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:25.608132 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lazy-loading 'fault' on Instance uuid 68e481aa-bf5a-436b-baca-f5c8b88de401 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:10:25.649133 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:25.657917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:25.659721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:25.660890 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-05bbe42c-0325-458b-a4d7-b80ff5b76ec4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1371 microversion: 2.20 time: 0.100356 Aug 18 17:10:25.661448 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 297/638] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:25 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1371 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:25.781758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-dddef713-7403-4d41-b2f9-7d69c6590f7e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:25.784093 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-dddef713-7403-4d41-b2f9-7d69c6590f7e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:25.790733 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dddef713-7403-4d41-b2f9-7d69c6590f7e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:25.791222 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dddef713-7403-4d41-b2f9-7d69c6590f7e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:25.791707 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dddef713-7403-4d41-b2f9-7d69c6590f7e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:25.792408 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dddef713-7403-4d41-b2f9-7d69c6590f7e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:25.792863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dddef713-7403-4d41-b2f9-7d69c6590f7e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:25.793288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dddef713-7403-4d41-b2f9-7d69c6590f7e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:26.077629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-dddef713-7403-4d41-b2f9-7d69c6590f7e tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "POST /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/action" status: 202 len: 0 microversion: 2.1 time: 0.300012 Aug 18 17:10:26.078187 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 342/639] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:10:25 2022] POST /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/action => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:10:26.086317 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:26.086962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:26.093610 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:26.094117 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:26.094547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:26.095230 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:26.095710 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:26.096133 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:26.238969 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:26.247051 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-991d8f75-5f80-4a24-a4e2-68642a8ee144 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1751 microversion: 2.1 time: 0.164632 Aug 18 17:10:26.247644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 298/640] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:26 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:26.684513 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:26.685247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:26.691548 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:26.692031 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:26.692468 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:26.693157 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:26.693611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:26.694035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:26.725148 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:26.725657 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:26.726063 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:26.726506 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lazy-loading 'fault' on Instance uuid 68e481aa-bf5a-436b-baca-f5c8b88de401 {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:10:26.767261 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:26.776610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:26.778138 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:26.779994 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-38ed232d-2334-4f98-a808-06bfb0d97f49 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 200 len: 1371 microversion: 2.20 time: 0.099121 Aug 18 17:10:26.784276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 343/641] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:26 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 1371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:27.268508 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:27.271273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:27.276164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:27.276650 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:27.277100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:27.277793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:27.278248 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:27.278670 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:27.516655 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:27.527256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1218d407-a1d9-4aad-9240-ed1e8cd9de06 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1751 microversion: 2.1 time: 0.262870 Aug 18 17:10:27.527998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 299/642] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:27 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:27.802209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:27.802822 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:27.809373 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:27.809853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:27.810795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:27.811502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:27.811962 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:27.812387 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:27.825666 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] HTTP exception thrown: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Request method failure captured: Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 HTTP/1.1 Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFaLcpNJBVDzjfR7XfrIVdHb-IYr4Au8vPBw8GSzWj9m60UknQqhkymKV4Sa_J6_nLyBG1mgVG0NtjqEm5aNhUmj5b8Wi0odYDE-HWXk-426CTGgYwmvXk-4ZAedfg_i1S5UqJA-vXIVbq0SU3mNfVBqKxnqf-AfopPvypB51YDGZc Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:10:27.828226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_697adc4a3b0f40ff85d6b415b6bbbefd", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fa85bec641f4c2391af50d66339d9fe Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:10:27.829806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '68e481aa-bf5a-436b-baca-f5c8b88de401'} Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:10:27.830689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:10:27.832046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:10:27.833446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Returning 404 to user: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:10:27.833446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4ca377a7-cc71-4aec-9954-78a357f824c2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 404 len: 111 microversion: 2.20 time: 0.030974 Aug 18 17:10:27.833446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 344/643] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:27 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:10:27.838414 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-23c385f0-a113-4bd8-b9a9-19db1a2e7ed4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '.version_select at 0x7ff5b4dcf310>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:27.928100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-901520174", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "networks": [{"uuid": "cedc50d6-8585-4b64-a3ce-7cee180068fc"}]}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:27.944277 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-23c385f0-a113-4bd8-b9a9-19db1a2e7ed4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-702112635" status: 204 len: 0 microversion: 2.20 time: 0.109443 Aug 18 17:10:27.945552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 300/644] 10.222.0.78 () {60 vars in 1259 bytes} [Thu Aug 18 17:10:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-702112635 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 17:10:27.985371 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.network.neutron [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] validate_networks() for [('cedc50d6-8585-4b64-a3ce-7cee180068fc', None, None, None, None, None)] {{(pid=121267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:10:28.355610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Flavor limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:10:28.356116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Image limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:10:28.356671 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Flavor pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:10:28.357192 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Image pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:10:28.357698 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:10:28.367359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:28.368016 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:28.368520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:28.369329 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:28.369858 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:28.370362 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:28.389713 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Getting quotas for project 50036d9fc240431fbcd0b75ed17248fd. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:10:28.394368 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Getting quotas for user ff492aa3ff514be8a7bfebdf8241e79a and project 50036d9fc240431fbcd0b75ed17248fd. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:10:28.407905 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Going to run 1 instances... {{(pid=121267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:10:28.410268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:10:28.550434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:28.551042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:28.553777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-79c9b9e5-714a-4f10-8a4a-5d043d8b607f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.629595 Aug 18 17:10:28.555098 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 345/645] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:10:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:10:28.564256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:28.565023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:28.565454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:28.566311 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:28.566916 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:28.567654 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:28.567777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-41005430-64b5-4cd9-80fa-c11b83fd37b8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:28.568902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-41005430-64b5-4cd9-80fa-c11b83fd37b8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:28.626708 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-41005430-64b5-4cd9-80fa-c11b83fd37b8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:28.634910 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-41005430-64b5-4cd9-80fa-c11b83fd37b8 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1218 microversion: 2.1 time: 0.072768 Aug 18 17:10:28.635505 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 346/646] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:28 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:28.828165 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:28.837483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d23408de-4048-4c56-b18f-ddff5faa9b8d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.291542 Aug 18 17:10:28.838091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 301/647] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:28 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:29.115976 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cb938af6-d73c-4653-9b69-98c5680f89dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'create', calling method: .version_select at 0x7ff5b4ceb670>, body: {"keypair": {"name": "tempest-keypair-585950943", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC+5DGZi28HRm4lGaM16uHCRl2PGwxtpRyL8wxwFzVkDNJoq5JSen5nqRjjP+JifDb1w+2ZKm4IyWutEqyv14EzCIo6FcY2MfPUFG+PDaxHa/xnBRgnYiG7eXb0qw0DjDQ=="}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:29.132509 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-cb938af6-d73c-4653-9b69-98c5680f89dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Getting quotas for project 697adc4a3b0f40ff85d6b415b6bbbefd. Resources: {'key_pairs'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:10:29.139188 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-cb938af6-d73c-4653-9b69-98c5680f89dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Getting quotas for user 1fa85bec641f4c2391af50d66339d9fe and project 697adc4a3b0f40ff85d6b415b6bbbefd. Resources: {'key_pairs'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:10:29.228757 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cb938af6-d73c-4653-9b69-98c5680f89dc tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.116607 Aug 18 17:10:29.229403 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 347/648] 10.222.0.78 () {62 vars in 1200 bytes} [Thu Aug 18 17:10:29 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 118 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 18 17:10:29.656750 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:29.657394 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:29.664108 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:29.664604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:29.665057 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:29.665750 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:29.666199 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:29.666710 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:29.687566 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:29.732293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:29.740723 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-93e69cf9-7dbd-4573-ab05-be9d8e9cd9eb tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1222 microversion: 2.1 time: 0.088337 Aug 18 17:10:29.741313 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 302/649] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:29 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:29.860679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:29.861294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:29.867446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:29.867941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:29.868383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:29.869071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:29.869515 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:29.869933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:30.079382 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:30.088774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8270a300-5cb3-40d8-87b4-554b5ea0bf4b tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.232271 Aug 18 17:10:30.089361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 348/650] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:29 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:30.765483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:30.766100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:30.775519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:30.776574 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:30.777019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:30.784372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:30.784372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:30.784372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:30.843957 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:30.852791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6b9dbc4a-cbe7-4f25-bb8a-831b8838cfc9 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1278 microversion: 2.1 time: 0.092277 Aug 18 17:10:30.853598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 303/651] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:30 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:31.113082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:31.113805 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:31.120772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:31.121374 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:31.122197 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:31.123189 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:31.123731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:31.124229 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:31.128703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:31.327822 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:31.337095 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cbddc5e7-de59-4968-8fe0-429e3cf05b3f tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.229902 Aug 18 17:10:31.347739 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 349/652] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:31 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:31.710886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2128729661", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8be6f688-0f91-4174-bb68-fa46841659a9"}], "security_groups": [{"name": "tempest-securitygroup--774829239"}], "key_name": "tempest-keypair-585950943", "user_data": "}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:31.859429 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] validate_networks() for [('8be6f688-0f91-4174-bb68-fa46841659a9', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:10:31.877388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:31.877999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:31.884322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:31.884853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:31.885283 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:31.886001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:31.886446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:31.886862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:32.029633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:32.037838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f1d2041f-d37c-42f7-97c5-7fc4aa20f204 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.165324 Aug 18 17:10:32.038425 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 350/653] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:31 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:32.359073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:32.359772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:32.366627 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:32.367133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:32.367709 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:32.368569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:32.369106 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:32.369534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:32.411219 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:10:32.411676 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:10:32.412158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:10:32.412568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:10:32.413009 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:10:32.422998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:32.423518 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:32.423962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:32.424694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:32.425189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:32.425613 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:32.453675 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Getting quotas for project 697adc4a3b0f40ff85d6b415b6bbbefd. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:10:32.457305 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Getting quotas for user 1fa85bec641f4c2391af50d66339d9fe and project 697adc4a3b0f40ff85d6b415b6bbbefd. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:10:32.469519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:10:32.472539 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:10:32.526966 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:32.536485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-526d719c-8734-4c73-9d93-f85a1e32ea17 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.182070 Aug 18 17:10:32.537140 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 351/654] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:32 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:32.541735 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-80cb5bba-16e7-4951-b066-7b3bd466f98c req-ba26b86d-9a35-4510-a03b-72967d4d4f36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "098c14b1-7597-4367-b573-ce4c70d7988e", "tag": "c4d87ed4-61d5-4e83-b65f-60b75d845742"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:32.551879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-80cb5bba-16e7-4951-b066-7b3bd466f98c req-ba26b86d-9a35-4510-a03b-72967d4d4f36 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:32.552364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-80cb5bba-16e7-4951-b066-7b3bd466f98c req-ba26b86d-9a35-4510-a03b-72967d4d4f36 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:32.552795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-80cb5bba-16e7-4951-b066-7b3bd466f98c req-ba26b86d-9a35-4510-a03b-72967d4d4f36 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:32.563979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-80cb5bba-16e7-4951-b066-7b3bd466f98c req-ba26b86d-9a35-4510-a03b-72967d4d4f36 service nova] Creating event network-changed:c4d87ed4-61d5-4e83-b65f-60b75d845742 for instance 098c14b1-7597-4367-b573-ce4c70d7988e on hv-cinder-85367 Aug 18 17:10:32.568743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-80cb5bba-16e7-4951-b066-7b3bd466f98c req-ba26b86d-9a35-4510-a03b-72967d4d4f36 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030407 Aug 18 17:10:32.569233 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 352/655] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:10:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:32.657141 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b18663fc-1b5a-4e84-bcb0-3d5e89b03ce8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.950582 Aug 18 17:10:32.657794 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 304/656] 10.222.0.78 () {62 vars in 1188 bytes} [Thu Aug 18 17:10:31 2022] POST /compute/v2.1/servers => generated 401 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 18 17:10:32.669392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-df9c538b-7184-47dd-8db0-49899841d86a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:32.670408 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-df9c538b-7184-47dd-8db0-49899841d86a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:32.728809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-df9c538b-7184-47dd-8db0-49899841d86a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:32.737046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-df9c538b-7184-47dd-8db0-49899841d86a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:32.738563 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-df9c538b-7184-47dd-8db0-49899841d86a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:32.739760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-df9c538b-7184-47dd-8db0-49899841d86a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1281 microversion: 2.20 time: 0.074657 Aug 18 17:10:32.740318 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 353/657] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:32 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:33.061348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:33.067776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:33.077527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:33.077935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:33.078518 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:33.079385 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:33.079951 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:33.080391 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:33.261913 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:33.269990 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a5b80d21-f1a7-41b0-9bff-2358a1c25891 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.215670 Aug 18 17:10:33.270601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 305/658] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:33 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:33.558145 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:33.558766 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:33.570363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:33.570971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:33.571529 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:33.572331 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:33.572787 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:33.584036 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:33.730310 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:33.739153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6d1735f8-9b6c-418e-b8c7-7c8658410fdb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.184933 Aug 18 17:10:33.739749 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 354/659] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:33 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:33.762315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:33.762929 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:33.769301 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:33.769777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:33.770204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:33.770920 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:33.771372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:33.771827 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:33.840774 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:33.849479 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:33.850987 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:33.852125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4ebdc6d8-53c0-4471-b1ed-a5e2fade1df2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1285 microversion: 2.20 time: 0.093745 Aug 18 17:10:33.852685 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 306/660] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:33 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:34.290559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:34.291091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:34.297613 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:34.298099 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:34.298537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:34.299225 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:34.299709 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:34.300137 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:34.428659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:34.436856 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0f66e034-04d1-43fa-b82a-14acfa995954 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.150414 Aug 18 17:10:34.437419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 355/661] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:34 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:34.760983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:34.761631 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:34.768601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:34.769086 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:34.769523 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:34.770218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:34.770677 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:34.771109 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:34.874156 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:34.874761 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:34.881260 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:34.881745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:34.882180 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:34.882880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:34.883338 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:34.883793 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:34.912866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:34.921326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-30e612a9-c321-4ff8-a07f-1bc965d6ef27 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.164128 Aug 18 17:10:34.921923 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 307/662] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:34 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:34.951301 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:34.959491 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:34.961007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:34.962116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-36ba8003-f4a0-4b87-a4fd-092dd9c28c9c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1277 microversion: 2.20 time: 0.091884 Aug 18 17:10:34.962669 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 356/663] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:34 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:10:34.972258 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:34.972873 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:34.979186 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:34.979701 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:34.980141 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:34.980835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:34.981290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:34.981719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:35.062511 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lazy-loading 'services' on Instance uuid 10ee2546-05c3-461e-bbc0-64cb39d936f7 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:10:35.323975 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d70ddc63-8190-407b-bc9d-c050f4d18f60 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "DELETE /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments/b2612312-4a00-402b-862e-7c85ad43ed39" status: 202 len: 0 microversion: 2.1 time: 0.355379 Aug 18 17:10:35.324494 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 308/664] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:10:34 2022] DELETE /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments/b2612312-4a00-402b-862e-7c85ad43ed39 => generated 0 bytes in 357 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:10:35.333502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-17d801b1-7b3c-421d-8542-ef4577ddf3d1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:35.335786 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-17d801b1-7b3c-421d-8542-ef4577ddf3d1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:35.341843 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17d801b1-7b3c-421d-8542-ef4577ddf3d1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:35.342491 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17d801b1-7b3c-421d-8542-ef4577ddf3d1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:35.342830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17d801b1-7b3c-421d-8542-ef4577ddf3d1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:35.344540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17d801b1-7b3c-421d-8542-ef4577ddf3d1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:35.344540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17d801b1-7b3c-421d-8542-ef4577ddf3d1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:35.344540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-17d801b1-7b3c-421d-8542-ef4577ddf3d1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:35.374092 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-17d801b1-7b3c-421d-8542-ef4577ddf3d1 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044386 Aug 18 17:10:35.374875 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 357/665] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:10:35 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:35.457863 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:35.458560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:35.464766 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:35.465249 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:35.465697 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:35.466401 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:35.466850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:35.467275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:35.598769 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:35.606302 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a75502e4-f98e-4fc8-b21b-3fe9b95bad7a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.152690 Aug 18 17:10:35.607386 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 309/666] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:35 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:35.942219 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:35.942849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:35.949726 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:35.950346 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:35.950787 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:35.951528 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:35.951995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:35.952449 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:35.986462 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:35.987313 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:35.994044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:35.997552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:35.997552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:35.997552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:35.997552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:35.997918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:36.060475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:36.069763 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:36.071307 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:36.072478 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-11b6527d-cd16-4bb6-accd-ca7117d8d6c3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1341 microversion: 2.20 time: 0.090731 Aug 18 17:10:36.073044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 310/667] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:35 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:10:36.111965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:36.117411 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1226336b-f281-44af-acc2-fdd983351868 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.178993 Aug 18 17:10:36.118906 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 358/668] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:35 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:36.388497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6735bcbc-cb14-42e1-8df3-c589f3d51bfa tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:36.391788 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6735bcbc-cb14-42e1-8df3-c589f3d51bfa tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:36.400022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6735bcbc-cb14-42e1-8df3-c589f3d51bfa tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:36.400522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6735bcbc-cb14-42e1-8df3-c589f3d51bfa tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:36.400958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6735bcbc-cb14-42e1-8df3-c589f3d51bfa tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:36.401722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6735bcbc-cb14-42e1-8df3-c589f3d51bfa tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:36.402374 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6735bcbc-cb14-42e1-8df3-c589f3d51bfa tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:36.402800 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6735bcbc-cb14-42e1-8df3-c589f3d51bfa tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:36.442080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6735bcbc-cb14-42e1-8df3-c589f3d51bfa tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059201 Aug 18 17:10:36.442973 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 311/669] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:10:36 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:36.627631 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:36.628290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:36.634566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:36.635053 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:36.635715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:36.640220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:36.640220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:36.640220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:36.819348 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:36.827904 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-64dbc5c5-a151-4d21-9310-d2c237f30815 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.204108 Aug 18 17:10:36.828481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 359/670] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:36 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:37.094688 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:37.095308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:37.102568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.103069 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.103547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.104260 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.104892 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.105322 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.140613 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:37.141448 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:37.149631 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.150642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.151310 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.152321 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.153066 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.153701 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.204323 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:37.212995 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:37.217448 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:37.217448 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ad1967f8-82fe-4d07-8f0e-099f2019ae3c tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1339 microversion: 2.20 time: 0.125010 Aug 18 17:10:37.217448 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 312/671] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:37 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1339 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:37.304557 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:37.314135 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a2dcb808-34a3-4161-9b07-66391acebbdd tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.178293 Aug 18 17:10:37.315041 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 360/672] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:37 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:37.454653 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-11771e60-4226-497b-9008-dc736746646c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:37.457109 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-11771e60-4226-497b-9008-dc736746646c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:37.463889 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11771e60-4226-497b-9008-dc736746646c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.464729 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11771e60-4226-497b-9008-dc736746646c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.465418 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11771e60-4226-497b-9008-dc736746646c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.466210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11771e60-4226-497b-9008-dc736746646c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.466798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11771e60-4226-497b-9008-dc736746646c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.467282 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-11771e60-4226-497b-9008-dc736746646c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.500945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-11771e60-4226-497b-9008-dc736746646c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050292 Aug 18 17:10:37.501593 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 313/673] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:10:37 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:10:37.576952 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:37.577575 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:37.584288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.585209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.585651 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.586360 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.586817 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.587241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.619324 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:10:37.806032 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:37.849259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:37.849904 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:37.856238 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.856812 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.857321 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.858093 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.858705 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.859325 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.893787 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c61fbf61-0f20-4b10-83ab-7323efca667f tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "DELETE /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 204 len: 0 microversion: 2.1 time: 0.320544 Aug 18 17:10:37.894389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 361/674] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:10:37 2022] DELETE /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 17:10:37.975406 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:37.976137 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:37.982214 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.982696 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.983165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:37.983887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:37.984343 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:37.984766 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:38.088915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:38.098145 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0781c65d-8973-4b55-914a-4259112c4bd1 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.252944 Aug 18 17:10:38.099251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 314/675] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:37 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:38.132014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:38.140603 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4d3d7dea-96ef-4c60-849b-2f4ba2cd12e8 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1690 microversion: 2.1 time: 0.241765 Aug 18 17:10:38.141180 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 362/676] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:37 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1690 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:38.238343 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:38.239355 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:38.246275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:38.246799 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:38.247267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:38.248177 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:38.249573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:38.249885 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:38.335717 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:38.336291 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:38.343140 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:38.343713 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:38.350202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:38.350202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:38.350202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:38.350202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:38.396068 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:38.463318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:38.476211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:38.477181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:38.478442 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d4e81bb2-8007-4b49-86b8-ba8e2aa6ff8b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.244061 Aug 18 17:10:38.479210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 315/677] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:38 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:38.484906 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-7bc3be51-1898-4085-9374-1f53d00c9d51 req-5783ffaf-fe66-47e9-b9e8-9b605a49296b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "098c14b1-7597-4367-b573-ce4c70d7988e", "name": "network-vif-plugged", "status": "completed", "tag": "c4d87ed4-61d5-4e83-b65f-60b75d845742"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:38.494672 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-7bc3be51-1898-4085-9374-1f53d00c9d51 req-5783ffaf-fe66-47e9-b9e8-9b605a49296b service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:38.495179 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-7bc3be51-1898-4085-9374-1f53d00c9d51 req-5783ffaf-fe66-47e9-b9e8-9b605a49296b service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:38.495631 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-7bc3be51-1898-4085-9374-1f53d00c9d51 req-5783ffaf-fe66-47e9-b9e8-9b605a49296b service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:38.508510 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-7bc3be51-1898-4085-9374-1f53d00c9d51 req-5783ffaf-fe66-47e9-b9e8-9b605a49296b service nova] Creating event network-vif-plugged:c4d87ed4-61d5-4e83-b65f-60b75d845742 for instance 098c14b1-7597-4367-b573-ce4c70d7988e on hv-cinder-85367 Aug 18 17:10:38.515022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-7bc3be51-1898-4085-9374-1f53d00c9d51 req-5783ffaf-fe66-47e9-b9e8-9b605a49296b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033284 Aug 18 17:10:38.516077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 316/678] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:38.526315 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:38.534494 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3052446c-7186-407a-943f-0f702744bec2 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.202893 Aug 18 17:10:38.535074 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 363/679] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:38 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:38.644910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-e970746e-2cf6-4d68-9112-561117e239b0 req-f36a215b-acf5-4071-b8e7-9de8ecbfb88b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5400d9b3-34f6-451c-bb5c-ae2b231dcc5b", "tag": "6a4d4f56-49e2-4fd7-905b-4ed206d8d756"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:38.654999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-e970746e-2cf6-4d68-9112-561117e239b0 req-f36a215b-acf5-4071-b8e7-9de8ecbfb88b service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:38.655410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-e970746e-2cf6-4d68-9112-561117e239b0 req-f36a215b-acf5-4071-b8e7-9de8ecbfb88b service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:38.655879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-e970746e-2cf6-4d68-9112-561117e239b0 req-f36a215b-acf5-4071-b8e7-9de8ecbfb88b service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:38.666962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-e970746e-2cf6-4d68-9112-561117e239b0 req-f36a215b-acf5-4071-b8e7-9de8ecbfb88b service nova] Creating event network-changed:6a4d4f56-49e2-4fd7-905b-4ed206d8d756 for instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b on hv-cinder-85367 Aug 18 17:10:38.672602 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-e970746e-2cf6-4d68-9112-561117e239b0 req-f36a215b-acf5-4071-b8e7-9de8ecbfb88b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031784 Aug 18 17:10:38.676215 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 317/680] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:10:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:39.118334 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:39.118946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:39.124855 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:39.125329 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:39.125761 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:39.126444 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:39.126897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:39.127325 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:39.162435 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:39.163582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:39.169549 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:39.175693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:39.175693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:39.175693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:39.175693 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:39.176182 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:39.271429 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:39.279318 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fcf1b606-00be-48a2-8834-8a0d5897d551 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.164789 Aug 18 17:10:39.284313 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 364/681] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:39 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:39.308597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:39.316478 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f10861fd-05ab-43ab-8364-eafd26c85734 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1690 microversion: 2.1 time: 0.158154 Aug 18 17:10:39.317054 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 318/682] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:39 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:39.501996 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:39.502600 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:39.509212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:39.509696 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:39.510211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:39.510849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:39.511302 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:39.513322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:39.556591 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:39.557207 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:39.563777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:39.564208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:39.564623 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:39.565320 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:39.565771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:39.566196 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:39.647279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:39.650660 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:39.656798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:39.661729 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:39.661729 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2987b52b-71e9-4862-a5e3-a056916f2510 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.161375 Aug 18 17:10:39.661729 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 365/683] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:39 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:39.714210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:39.723101 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1ccb78ed-81aa-483a-b404-8bafc6ca341a tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.170362 Aug 18 17:10:39.723710 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 319/684] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:39 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:40.300929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:40.301549 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:40.307782 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:40.308263 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:40.308699 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:40.309384 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:40.309838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:40.310259 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:40.337785 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:40.338394 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:40.344868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:40.345355 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:40.345786 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:40.346477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:40.346925 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:40.347342 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:40.366953 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:40.444543 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:40.452295 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4b59f77f-b1ae-431b-8c2c-3026565901aa tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.155540 Aug 18 17:10:40.452878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 366/685] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:40 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:40.482393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:40.490997 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ee059b12-1a9c-4486-babf-999d937017c0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1690 microversion: 2.1 time: 0.156979 Aug 18 17:10:40.491593 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 320/686] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:40 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1690 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:40.681756 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:40.682363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:40.688798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:40.689276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:40.689710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:40.690393 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:40.690845 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:40.691268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:40.743202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:40.743828 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:40.746674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:40.750137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:40.750611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:40.751046 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:40.751866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:40.752216 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:40.757824 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:40.824496 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:40.833704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:40.835285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:40.836442 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-eb8d2098-1453-4fee-9372-cfd6f6e76359 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.158588 Aug 18 17:10:40.837007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 367/687] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:40 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:10:40.900256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:40.908984 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4f73745e-e5d6-4ae6-83b3-bdc84e27bc1d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.169579 Aug 18 17:10:40.909562 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 321/688] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:40 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:41.473480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:41.474543 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:41.480414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:41.481194 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:41.481591 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:41.482394 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:41.482891 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:41.483322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:41.517257 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:41.517997 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:41.525345 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:41.525905 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:41.536789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:41.536789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:41.536789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:41.536789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:41.619685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:41.628573 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d2636649-6441-494a-8e87-7867a5c5c17a tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.158890 Aug 18 17:10:41.631476 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 368/689] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:41 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:41.686879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:41.695018 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e30bb504-0b60-4251-bb4f-8e69980ba939 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1690 microversion: 2.1 time: 0.183184 Aug 18 17:10:41.695612 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 322/690] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:41 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1690 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:41.860306 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:41.860944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:41.867327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:41.867838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:41.868278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:41.869004 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:41.869727 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:41.870158 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:41.929526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:41.930432 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:41.937607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:41.938123 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:41.938570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:41.939297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:41.939804 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:41.943429 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:42.271946 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:42.280837 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4f44dded-e9b9-43b7-8b7b-1aa9abad3ea3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1756 microversion: 2.1 time: 0.355139 Aug 18 17:10:42.291636 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 323/691] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:41 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1756 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:10:42.305386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:42.314328 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:42.315836 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:42.316960 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1da1dfa1-28de-45b4-b09a-4544c77bb216 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.461142 Aug 18 17:10:42.317528 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 369/692] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:41 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:42.651164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:42.651799 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:42.653628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:42.654719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=6 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:42.659965 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:42.660455 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:42.664518 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:42.664518 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:42.664518 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:42.664518 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:42.716218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:42.716927 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:42.723769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:42.724258 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:42.724694 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:42.725401 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:42.725856 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:42.726282 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:42.742268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=14 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:42.790886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:42.799925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c5d445d3-b98f-447a-ad61-fb8c72b453de tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1622 microversion: 2.1 time: 0.087648 Aug 18 17:10:42.800506 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 370/693] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:42 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1622 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:42.881828 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:42.889995 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-88259a44-67ca-4f8e-83b2-4d73d2ea2599 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.242539 Aug 18 17:10:42.890567 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 324/694] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:42 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:43.055252 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-12a030c0-ad4d-4a22-a652-3281e396b27c req-8661aa73-ace2-481a-acf6-a3794663b652 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ee2546-05c3-461e-bbc0-64cb39d936f7", "name": "network-vif-deleted", "tag": "4be84b1f-a309-40e8-8519-3e746d6a87a8"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:43.075901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-12a030c0-ad4d-4a22-a652-3281e396b27c req-8661aa73-ace2-481a-acf6-a3794663b652 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:43.077174 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-12a030c0-ad4d-4a22-a652-3281e396b27c req-8661aa73-ace2-481a-acf6-a3794663b652 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:43.078520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-12a030c0-ad4d-4a22-a652-3281e396b27c req-8661aa73-ace2-481a-acf6-a3794663b652 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:43.093717 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-12a030c0-ad4d-4a22-a652-3281e396b27c req-8661aa73-ace2-481a-acf6-a3794663b652 service nova] Creating event network-vif-deleted:4be84b1f-a309-40e8-8519-3e746d6a87a8 for instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 on hv-cinder-85367 Aug 18 17:10:43.100504 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-12a030c0-ad4d-4a22-a652-3281e396b27c req-8661aa73-ace2-481a-acf6-a3794663b652 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051228 Aug 18 17:10:43.101360 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 371/695] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:43.302407 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:43.303497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:43.309703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:43.310185 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:43.310679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:43.312034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:43.312519 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:43.312980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:43.340687 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:43.341460 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:43.352926 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:43.353501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:43.354152 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:43.355104 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:43.355842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:43.356496 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:43.469883 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:43.478611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-72a16f5d-2d75-4302-8475-50678268ebb3 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1759 microversion: 2.1 time: 0.180080 Aug 18 17:10:43.479289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 325/696] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:43 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1759 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:43.521234 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:43.528478 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:43.530495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:43.531668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d7b60d4c-11aa-4050-a055-a62c57c63327 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.195487 Aug 18 17:10:43.532553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 372/697] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:43 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:43.820640 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:43.821265 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:43.828504 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:43.829003 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:43.829447 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:43.830162 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:43.830832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:43.831055 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:43.898524 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:43.910858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-79d7f860-4523-4f6f-a3c1-abdaead54d65 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1330 microversion: 2.1 time: 0.094050 Aug 18 17:10:43.911602 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:43.912239 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 326/698] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:43 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:43.912397 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:43.918277 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:43.919001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:43.919482 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:43.920184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:43.920642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:43.921165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:44.070872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:44.078987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fd083d04-18e5-42a2-988d-97225199de3f tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1318 microversion: 2.1 time: 0.171246 Aug 18 17:10:44.079948 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 373/699] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:43 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:44.554881 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:44.555426 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:44.561930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:44.562408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:44.562835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:44.563552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:44.564008 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:44.564422 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:44.700018 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:44.708342 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:44.709868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:44.710980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-02612f5e-24c8-4fa2-a98a-2a7be7536c3b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.160196 Aug 18 17:10:44.711575 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 327/700] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:44 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:44.934944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:44.935602 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:44.941794 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:44.942281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:44.942715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:44.943415 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:44.943895 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:44.944321 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:44.974537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:44.975013 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:44.975468 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:44.975921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lazy-loading 'fault' on Instance uuid 10ee2546-05c3-461e-bbc0-64cb39d936f7 {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:10:45.019631 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:45.027388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a6cb5483-3a6c-4f07-a7ef-c43999d13994 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 200 len: 1335 microversion: 2.1 time: 0.096255 Aug 18 17:10:45.027995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 374/701] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:44 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 1335 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:45.099982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:45.100600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:45.107159 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:45.113702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:45.113702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:45.113702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:45.113702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:45.114076 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:45.248898 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:45.256735 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3248d15a-dde2-4f6b-9b99-23de99ce6327 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1506 microversion: 2.1 time: 0.160627 Aug 18 17:10:45.257433 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 328/702] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:45 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:45.277820 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a14c800b-de30-41cb-a5cf-682728e05f71 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "30854c34-c279-4c87-be0c-8e497cbede36", "device": "/dev/sdb"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:45.280336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a14c800b-de30-41cb-a5cf-682728e05f71 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:45.287184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a14c800b-de30-41cb-a5cf-682728e05f71 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:45.287729 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a14c800b-de30-41cb-a5cf-682728e05f71 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:45.288161 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a14c800b-de30-41cb-a5cf-682728e05f71 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:45.288852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a14c800b-de30-41cb-a5cf-682728e05f71 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:45.289345 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a14c800b-de30-41cb-a5cf-682728e05f71 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:45.289776 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a14c800b-de30-41cb-a5cf-682728e05f71 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:45.539187 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e3ad169a-5c94-446f-87b8-652374d2b1a5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:45.539734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e3ad169a-5c94-446f-87b8-652374d2b1a5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:45.545642 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3ad169a-5c94-446f-87b8-652374d2b1a5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:45.548872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3ad169a-5c94-446f-87b8-652374d2b1a5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:45.548872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3ad169a-5c94-446f-87b8-652374d2b1a5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:45.548872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3ad169a-5c94-446f-87b8-652374d2b1a5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:45.548872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3ad169a-5c94-446f-87b8-652374d2b1a5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:45.549263 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3ad169a-5c94-446f-87b8-652374d2b1a5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:45.570956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e3ad169a-5c94-446f-87b8-652374d2b1a5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/ips" status: 200 len: 150 microversion: 2.1 time: 0.096038 Aug 18 17:10:45.571526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 329/703] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:10:45 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/ips => generated 150 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:10:45.733875 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:45.734433 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:45.740402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:45.740884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:45.741350 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:45.742053 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:45.742508 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:45.742936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:45.879752 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:45.888029 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:45.889802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:45.891611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b16d69f1-6582-462f-82e2-631a5a28351f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.161081 Aug 18 17:10:45.892170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 330/704] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:45 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:10:46.049289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:46.049820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 10ee2546-05c3-461e-bbc0-64cb39d936f7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:46.055948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:46.056547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:46.057076 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:46.057764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:46.058215 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:46.058636 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] HTTP exception thrown: Instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 could not be found. Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Request method failure captured: Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 HTTP/1.1 Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFhH2yYX7xcdPCDSwWtSZHmnOE-W47U9s3JNZq7u1jv_RuXGKvu0b-fH9zNDVd5do94K1mzWLrv10OXD1Mlrr-WZ-r-XBg5yRUddndOLc3xkh9Q0nGpQt2Lqry8y5fv1tlt3ceTLX_8FOb6Js9mKZropmkuIjqsUIAy79tdGEJS88U Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:10:46.080089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ccc5c89023ff476ca3b85680f56f8899", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: a3bc033664c445f78b9d67440876c19d Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 could not be found. Aug 18 17:10:46.082089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '10ee2546-05c3-461e-bbc0-64cb39d936f7'} Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 could not be found. Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:10:46.082974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 could not be found. Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 could not be found. Aug 18 17:10:46.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:46.088266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Returning 404 to user: Instance 10ee2546-05c3-461e-bbc0-64cb39d936f7 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:10:46.088266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c0d30806-550c-435e-94e3-fa48167ad9f2 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7" status: 404 len: 111 microversion: 2.1 time: 0.034844 Aug 18 17:10:46.088266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 331/705] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:46 2022] GET /compute/v2.1/servers/10ee2546-05c3-461e-bbc0-64cb39d936f7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:10:46.089146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e0e0b140-08c2-4a63-be57-562fbec00f4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '.version_select at 0x7ff5b4dcf430>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:46.134175 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a14c800b-de30-41cb-a5cf-682728e05f71 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "POST /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.860315 Aug 18 17:10:46.137330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 375/706] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:10:45 2022] POST /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e/os-volume_attachments => generated 194 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:46.224204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e0e0b140-08c2-4a63-be57-562fbec00f4c tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-352442099" status: 202 len: 0 microversion: 2.1 time: 0.138782 Aug 18 17:10:46.231077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 332/707] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Aug 18 17:10:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-352442099 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:10:46.914547 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:46.915246 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:46.922533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:46.923023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:46.923478 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:46.924185 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:46.924642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:46.925121 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:47.087409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:47.096383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:47.098007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:47.099446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6dff8a83-a280-4e68-b117-8578ced9e984 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.189295 Aug 18 17:10:47.103536 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 376/708] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:46 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:47.208541 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-05f1ce6b-e739-4292-b8d4-2b0c8c08056c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "290572af-0bd0-439a-b81c-3a4a27beab14"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:47.211021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-05f1ce6b-e739-4292-b8d4-2b0c8c08056c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:47.219510 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05f1ce6b-e739-4292-b8d4-2b0c8c08056c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:47.219998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05f1ce6b-e739-4292-b8d4-2b0c8c08056c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:47.220437 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05f1ce6b-e739-4292-b8d4-2b0c8c08056c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:47.221135 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05f1ce6b-e739-4292-b8d4-2b0c8c08056c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:47.221589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05f1ce6b-e739-4292-b8d4-2b0c8c08056c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:47.222011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05f1ce6b-e739-4292-b8d4-2b0c8c08056c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:48.116231 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-05f1ce6b-e739-4292-b8d4-2b0c8c08056c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.911631 Aug 18 17:10:48.116956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 333/709] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:10:47 2022] POST /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments => generated 194 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:10:48.122405 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:48.123696 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:48.130910 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:48.131404 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:48.132034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:48.132759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:48.133249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:48.133678 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:48.280764 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:48.281071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:48.282701 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:48.283976 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6b41c17e-1e84-4c80-857a-539b36dc66e8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.165522 Aug 18 17:10:48.284979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 377/710] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:48 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:48.491240 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-5b5ff922-28b1-45d8-ac5d-bb5f0b1e1ed3 req-e6ace850-5286-4372-b8f7-efcb34ba9ae9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5400d9b3-34f6-451c-bb5c-ae2b231dcc5b", "name": "network-vif-plugged", "status": "completed", "tag": "6a4d4f56-49e2-4fd7-905b-4ed206d8d756"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:48.502725 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5b5ff922-28b1-45d8-ac5d-bb5f0b1e1ed3 req-e6ace850-5286-4372-b8f7-efcb34ba9ae9 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:48.503210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5b5ff922-28b1-45d8-ac5d-bb5f0b1e1ed3 req-e6ace850-5286-4372-b8f7-efcb34ba9ae9 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:48.503676 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5b5ff922-28b1-45d8-ac5d-bb5f0b1e1ed3 req-e6ace850-5286-4372-b8f7-efcb34ba9ae9 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:48.514954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-5b5ff922-28b1-45d8-ac5d-bb5f0b1e1ed3 req-e6ace850-5286-4372-b8f7-efcb34ba9ae9 service nova] Creating event network-vif-plugged:6a4d4f56-49e2-4fd7-905b-4ed206d8d756 for instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b on hv-cinder-85367 Aug 18 17:10:48.520213 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-5b5ff922-28b1-45d8-ac5d-bb5f0b1e1ed3 req-e6ace850-5286-4372-b8f7-efcb34ba9ae9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033692 Aug 18 17:10:48.521068 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 334/711] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:10:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:49.308331 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:49.308939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:49.319023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:49.319023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:49.319023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:49.319023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:49.319490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:49.319490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:49.451699 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:49.459976 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:49.461460 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:49.463224 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1b1f54a3-eae6-4a35-880c-e757e8a3d88d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1406 microversion: 2.20 time: 0.158827 Aug 18 17:10:49.464463 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 378/712] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:49 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:49.906716 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:49.907303 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:49.913989 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:49.914474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:49.914907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:49.915640 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:49.916098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:49.916526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:49.941089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:10:50.243510 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8b287c1e-5ba4-48f8-9c67-de4dadcb7985 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "DELETE /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 204 len: 0 microversion: 2.1 time: 0.340648 Aug 18 17:10:50.244104 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 335/713] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:10:49 2022] DELETE /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:10:50.252216 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:50.252998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:50.259302 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:50.262525 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:50.262525 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:50.262525 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:50.262525 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:50.262929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:50.397413 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:50.405121 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f19a879b-b5f9-4ba9-8aa9-bd322336c4db tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1508 microversion: 2.1 time: 0.156911 Aug 18 17:10:50.405683 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 379/714] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:50 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:50.487228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:50.487961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:50.493920 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:50.494342 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:50.494784 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:50.495510 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:50.495968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:50.496395 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:50.632497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:50.636151 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:50.641416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:50.642906 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:50.644292 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-cb5f3f56-32cf-42c9-b409-e7d4b9fb78db tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1598 microversion: 2.20 time: 0.161695 Aug 18 17:10:50.646153 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 336/715] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:10:50 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1598 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:10:50.668231 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3a29ab1c-8b73-4a4b-aaf0-6b92ddde65ba tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:50.668727 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3a29ab1c-8b73-4a4b-aaf0-6b92ddde65ba tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:50.675455 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3a29ab1c-8b73-4a4b-aaf0-6b92ddde65ba tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:50.675955 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3a29ab1c-8b73-4a4b-aaf0-6b92ddde65ba tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:50.676394 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3a29ab1c-8b73-4a4b-aaf0-6b92ddde65ba tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:50.677089 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3a29ab1c-8b73-4a4b-aaf0-6b92ddde65ba tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:50.677542 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3a29ab1c-8b73-4a4b-aaf0-6b92ddde65ba tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:50.678075 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3a29ab1c-8b73-4a4b-aaf0-6b92ddde65ba tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:50.755488 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3a29ab1c-8b73-4a4b-aaf0-6b92ddde65ba tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091192 Aug 18 17:10:50.756090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 380/716] 10.222.0.78 () {60 vars in 1316 bytes} [Thu Aug 18 17:10:50 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:10:51.426900 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:51.427764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:51.435005 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:51.435551 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:51.435992 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:51.436694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:51.437152 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:51.437712 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:51.577560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:51.586078 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-401cea45-730e-4181-a898-98d8a8cfd6da tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1508 microversion: 2.1 time: 0.163623 Aug 18 17:10:51.586754 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 337/717] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:51 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:51.776103 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-bb0ce8fc-a300-420d-9640-51409af45604 req-e1a7b105-c643-4331-8617-847ffa9dce55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5400d9b3-34f6-451c-bb5c-ae2b231dcc5b", "tag": "6a4d4f56-49e2-4fd7-905b-4ed206d8d756"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:51.789620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-bb0ce8fc-a300-420d-9640-51409af45604 req-e1a7b105-c643-4331-8617-847ffa9dce55 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:51.789620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-bb0ce8fc-a300-420d-9640-51409af45604 req-e1a7b105-c643-4331-8617-847ffa9dce55 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:51.789620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-bb0ce8fc-a300-420d-9640-51409af45604 req-e1a7b105-c643-4331-8617-847ffa9dce55 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:51.797809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-bb0ce8fc-a300-420d-9640-51409af45604 req-e1a7b105-c643-4331-8617-847ffa9dce55 service nova] Creating event network-changed:6a4d4f56-49e2-4fd7-905b-4ed206d8d756 for instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b on hv-cinder-85367 Aug 18 17:10:51.803678 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-bb0ce8fc-a300-420d-9640-51409af45604 req-e1a7b105-c643-4331-8617-847ffa9dce55 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031635 Aug 18 17:10:51.804273 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 381/718] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:52.606188 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:52.606798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:52.615039 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:52.616025 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:52.616147 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:52.616811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:52.617392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:52.617824 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:52.796421 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:52.804308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3783bac3-cc9a-4deb-a2ea-bc2478ccf112 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1508 microversion: 2.1 time: 0.201987 Aug 18 17:10:52.805932 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 338/719] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:52 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1508 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:53.826811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:53.827450 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:53.834523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:53.835272 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:53.835952 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:53.836879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:53.837450 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:53.837943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:53.856954 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:10:54.015208 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:54.022872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-941a6bec-1333-4ff9-8475-1c8538cc5c80 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1508 microversion: 2.1 time: 0.200932 Aug 18 17:10:54.023464 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 382/720] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:53 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1508 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:54.185044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-6048a785-062e-492a-90d6-5a7ac1b85cb9 req-112f8ab2-9ee5-4220-9673-e8b7e3401843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61f40fc8-4d8a-4aac-b8f5-84ec963fabd7", "name": "network-vif-deleted", "tag": "a85a9ff0-70eb-48e8-a79f-7454c12baa1a"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:10:54.195113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-6048a785-062e-492a-90d6-5a7ac1b85cb9 req-112f8ab2-9ee5-4220-9673-e8b7e3401843 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:54.195635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-6048a785-062e-492a-90d6-5a7ac1b85cb9 req-112f8ab2-9ee5-4220-9673-e8b7e3401843 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:54.196075 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-6048a785-062e-492a-90d6-5a7ac1b85cb9 req-112f8ab2-9ee5-4220-9673-e8b7e3401843 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:54.207968 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-6048a785-062e-492a-90d6-5a7ac1b85cb9 req-112f8ab2-9ee5-4220-9673-e8b7e3401843 service nova] Creating event network-vif-deleted:a85a9ff0-70eb-48e8-a79f-7454c12baa1a for instance 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 on hv-cinder-85367 Aug 18 17:10:54.212842 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-6048a785-062e-492a-90d6-5a7ac1b85cb9 req-112f8ab2-9ee5-4220-9673-e8b7e3401843 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031943 Aug 18 17:10:54.213466 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 339/721] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:10:55.044193 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:55.044923 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:55.052658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:55.053147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:55.053585 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:55.054477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:55.054942 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:55.055370 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:55.090888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:55.091425 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:55.091935 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:55.092385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lazy-loading 'fault' on Instance uuid 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:10:55.136664 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:55.145182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e08e2c7d-5e39-425b-9327-d98c41e66317 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 200 len: 1311 microversion: 2.1 time: 0.105492 Aug 18 17:10:55.147274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 383/722] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:55 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 1311 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:56.167157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:56.167915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:56.174108 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:56.174590 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:56.175026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:56.175751 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:56.176209 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:56.176634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:56.189667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] HTTP exception thrown: Instance 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 could not be found. Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Request method failure captured: Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 HTTP/1.1 Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFhH2yYX7xcdPCDSwWtSZHmnOE-W47U9s3JNZq7u1jv_RuXGKvu0b-fH9zNDVd5do94K1mzWLrv10OXD1Mlrr-WZ-r-XBg5yRUddndOLc3xkh9Q0nGpQt2Lqry8y5fv1tlt3ceTLX_8FOb6Js9mKZropmkuIjqsUIAy79tdGEJS88U Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:10:56.191259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ccc5c89023ff476ca3b85680f56f8899", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: a3bc033664c445f78b9d67440876c19d Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 could not be found. Aug 18 17:10:56.192772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '61f40fc8-4d8a-4aac-b8f5-84ec963fabd7'} Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 could not be found. Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:10:56.193795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 could not be found. Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 could not be found. Aug 18 17:10:56.195208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:10:56.196508 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Returning 404 to user: Instance 61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:10:56.196508 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2c8485ed-5885-4c9d-b47c-49d239978677 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7" status: 404 len: 111 microversion: 2.1 time: 0.030288 Aug 18 17:10:56.196508 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 340/723] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:56 2022] GET /compute/v2.1/servers/61f40fc8-4d8a-4aac-b8f5-84ec963fabd7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:10:56.201990 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:56.202484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:56.209293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:56.209772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:56.210238 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:56.210891 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:56.211356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:56.211800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:56.238159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:10:56.706201 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8bd3087a-e408-4070-8938-dcc3ef5cfbed tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "DELETE /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 204 len: 0 microversion: 2.1 time: 0.508449 Aug 18 17:10:56.706793 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 384/724] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:10:56 2022] DELETE /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:10:56.714963 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:56.715607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:56.722313 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:56.724883 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:56.724883 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:56.724883 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:56.724883 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:56.725269 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:56.858014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:56.865848 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0e519592-6bb2-4e8c-8cca-4e0d7c098938 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.154792 Aug 18 17:10:56.866423 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 341/725] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:56 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:57.887610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:57.888314 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:57.895619 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:57.896108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:57.896551 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:57.897244 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:57.897700 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:57.898126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:58.026672 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:58.034983 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a0613c82-3e1f-4c64-a328-f34c21685d0e tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.151621 Aug 18 17:10:58.035578 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 385/726] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:57 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:10:59.055826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:10:59.056432 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:10:59.062850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:59.063337 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:59.063807 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:59.065172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:10:59.065468 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:10:59.065890 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:10:59.206314 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:10:59.214357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-27be45f9-6ab5-4724-aa9c-11fade8f56bc tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.162513 Aug 18 17:10:59.214936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 342/727] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:10:59 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:00.236694 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:00.237338 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:00.243996 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:00.244482 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:00.244920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:00.245663 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:00.246123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:00.246551 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:00.371743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:00.379416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-40875ce6-864b-44e3-990c-6fb6ed319fc0 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.147202 Aug 18 17:11:00.380028 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 386/728] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:00 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:01.399913 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:01.400627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:01.407137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:01.408336 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:01.408765 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:01.409462 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:01.409922 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:01.410353 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:01.542582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:01.550775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-51e18610-fe3e-4dea-9a70-1bc1fa31d60b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.154797 Aug 18 17:11:01.551350 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 343/729] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:01 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:01.976391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:01.976922 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:01.983464 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:01.984007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:01.984438 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:01.985131 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:01.985577 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:01.986068 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:02.009449 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lazy-loading 'flavor' on Instance uuid 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:11:02.285733 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-38f5f03c-fc47-4a99-9e9a-6044e0f534f0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "POST /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1/action" status: 202 len: 0 microversion: 2.1 time: 0.313092 Aug 18 17:11:02.286330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 387/730] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:11:01 2022] POST /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1/action => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:11:02.294634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:02.295246 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:02.301785 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:02.302266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:02.302707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:02.303464 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:02.303938 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:02.304365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:02.435874 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:02.444338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9e04e376-0acc-4d0d-89ce-e14b704ddda4 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.153662 Aug 18 17:11:02.444903 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 344/731] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:02 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:02.572100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:02.572721 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:02.578830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:02.579304 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:02.579754 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:02.580433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:02.580881 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:02.581298 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:02.714722 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:02.723078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1d8ca9ba-fb39-459a-a53f-8654b00dd8a9 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.155315 Aug 18 17:11:02.723685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 388/732] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:02 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:03.466775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:03.467523 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:03.474308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:03.474833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:03.475277 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:03.476620 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:03.476800 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:03.477228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:03.614124 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:03.622197 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-41d51eb4-37d3-4143-a0d3-d67108375b22 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.159416 Aug 18 17:11:03.622784 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 345/733] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:03 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:03.755095 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:03.755095 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:03.755095 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:03.755095 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:03.755959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:03.755959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:03.755959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:03.755959 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:03.888444 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:03.896898 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3d7a869d-37c3-4bee-9ebc-01abdc211c8b tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1522 microversion: 2.1 time: 0.157186 Aug 18 17:11:03.897508 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 389/734] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:03 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:04.644289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:04.644911 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:04.651715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:04.652256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:04.652641 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:04.653347 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:04.653805 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:04.654228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:04.798668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:04.801708 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-5f8af604-8788-414c-b67b-09a364763c6f req-4acfed3a-225e-4383-9920-ec96a2a601af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "939d201c-6bc3-470f-9488-acd5f3ed99fd", "name": "network-vif-deleted", "tag": "13093e80-0e16-4f83-85a6-e6aed9ea2652"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:04.810249 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-88ca8d32-7277-427d-b8cc-af8f8847b647 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.169854 Aug 18 17:11:04.810905 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 346/735] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:04 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:04.811711 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5f8af604-8788-414c-b67b-09a364763c6f req-4acfed3a-225e-4383-9920-ec96a2a601af service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:04.812195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5f8af604-8788-414c-b67b-09a364763c6f req-4acfed3a-225e-4383-9920-ec96a2a601af service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:04.812631 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-5f8af604-8788-414c-b67b-09a364763c6f req-4acfed3a-225e-4383-9920-ec96a2a601af service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:04.829209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-5f8af604-8788-414c-b67b-09a364763c6f req-4acfed3a-225e-4383-9920-ec96a2a601af service nova] Creating event network-vif-deleted:13093e80-0e16-4f83-85a6-e6aed9ea2652 for instance 939d201c-6bc3-470f-9488-acd5f3ed99fd on hv-cinder-85367 Aug 18 17:11:04.846303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-5f8af604-8788-414c-b67b-09a364763c6f req-4acfed3a-225e-4383-9920-ec96a2a601af service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093803 Aug 18 17:11:04.846303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 390/736] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:11:04.917865 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:04.918552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:04.925912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:04.926389 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:04.927095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:04.927855 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:04.928329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:04.928749 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:05.006658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a3bc033664c445f78b9d67440876c19d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ccc5c89023ff476ca3b85680f56f8899', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:05.011909 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1a845a1a-f371-40da-b7ae-daee7f6044ef tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 200 len: 1480 microversion: 2.1 time: 0.097863 Aug 18 17:11:05.013528 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 347/737] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:04 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 1480 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:05.211710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "290572af-0bd0-439a-b81c-3a4a27beab14"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:05.214084 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:05.220250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:05.220759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:05.221198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:05.221883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:05.222336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:05.222759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:05.303857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Invalid volume: volume 290572af-0bd0-439a-b81c-3a4a27beab14 is already attached to instances: da756d85-46a8-4afd-bfbc-4e20051f6d10 Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: POST /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments HTTP/1.1 Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 74 Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:11:05.306940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {"volumeAttachment": {"volumeId": "290572af-0bd0-439a-b81c-3a4a27beab14"}} Aug 18 17:11:05.309122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Invalid volume: volume 290572af-0bd0-439a-b81c-3a4a27beab14 is already attached to instances: da756d85-46a8-4afd-bfbc-4e20051f6d10 Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'server_id': 'da756d85-46a8-4afd-bfbc-4e20051f6d10', 'body': {'volumeAttachment': {'volumeId': '290572af-0bd0-439a-b81c-3a4a27beab14'}}} Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5122, in attach_volume Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4962, in _check_volume_already_attached Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 290572af-0bd0-439a-b81c-3a4a27beab14 is already attached to instances: da756d85-46a8-4afd-bfbc-4e20051f6d10 Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:05.309971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 290572af-0bd0-439a-b81c-3a4a27beab14 is already attached to instances: da756d85-46a8-4afd-bfbc-4e20051f6d10 Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:05.311365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:05.312811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:05.312811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:11:05.312811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:11:05.312811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 290572af-0bd0-439a-b81c-3a4a27beab14 is already attached to instances: da756d85-46a8-4afd-bfbc-4e20051f6d10 Aug 18 17:11:05.312811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:05.312811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 400 to user: Invalid volume: volume 290572af-0bd0-439a-b81c-3a4a27beab14 is already attached to instances: da756d85-46a8-4afd-bfbc-4e20051f6d10 {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:11:05.312811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-de7c59e5-b2a9-4437-beee-0de28c5ba858 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101204 Aug 18 17:11:05.312811 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 391/738] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:11:05 2022] POST /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:11:05.375269 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:05.375798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:05.382357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:05.382837 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:05.383272 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:05.383992 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:05.384449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:05.384871 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:05.466794 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'services' on Instance uuid da756d85-46a8-4afd-bfbc-4e20051f6d10 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:11:05.687800 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d6f51ec5-c0ac-49ac-8e96-470a316d1f61 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments/290572af-0bd0-439a-b81c-3a4a27beab14" status: 202 len: 0 microversion: 2.1 time: 0.316299 Aug 18 17:11:05.689320 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 348/739] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:11:05 2022] DELETE /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments/290572af-0bd0-439a-b81c-3a4a27beab14 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:11:05.697628 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-65beca5f-4872-4317-8f87-4c262b937cff tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:05.699748 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-65beca5f-4872-4317-8f87-4c262b937cff tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:05.706358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-65beca5f-4872-4317-8f87-4c262b937cff tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:05.706849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-65beca5f-4872-4317-8f87-4c262b937cff tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:05.707284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-65beca5f-4872-4317-8f87-4c262b937cff tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:05.708050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-65beca5f-4872-4317-8f87-4c262b937cff tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:05.708495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-65beca5f-4872-4317-8f87-4c262b937cff tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:05.709008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-65beca5f-4872-4317-8f87-4c262b937cff tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:05.740628 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-65beca5f-4872-4317-8f87-4c262b937cff tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046917 Aug 18 17:11:05.741179 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 392/740] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:11:05 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:05.832703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:05.833414 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:05.840488 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:05.840984 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:05.841434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:05.842154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:05.842613 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:05.843042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:05.977197 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:05.984915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c29fb0c9-b275-4680-87f8-b3b71301d905 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.156651 Aug 18 17:11:05.985477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 349/741] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:05 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:06.034409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:06.035018 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] [instance: 939d201c-6bc3-470f-9488-acd5f3ed99fd] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:06.041492 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:06.041975 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:06.042408 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:06.043242 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:06.043569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:06.043994 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:06.058309 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] HTTP exception thrown: Instance 939d201c-6bc3-470f-9488-acd5f3ed99fd could not be found. Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Request method failure captured: Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd HTTP/1.1 Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFhH2yYX7xcdPCDSwWtSZHmnOE-W47U9s3JNZq7u1jv_RuXGKvu0b-fH9zNDVd5do94K1mzWLrv10OXD1Mlrr-WZ-r-XBg5yRUddndOLc3xkh9Q0nGpQt2Lqry8y5fv1tlt3ceTLX_8FOb6Js9mKZropmkuIjqsUIAy79tdGEJS88U Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:11:06.059878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ccc5c89023ff476ca3b85680f56f8899"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ccc5c89023ff476ca3b85680f56f8899", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: ccc5c89023ff476ca3b85680f56f8899 Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1503052600 Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: a3bc033664c445f78b9d67440876c19d Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1503052600-project Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 939d201c-6bc3-470f-9488-acd5f3ed99fd could not be found. Aug 18 17:11:06.066670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '939d201c-6bc3-470f-9488-acd5f3ed99fd'} Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 939d201c-6bc3-470f-9488-acd5f3ed99fd could not be found. Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:11:06.068416 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 939d201c-6bc3-470f-9488-acd5f3ed99fd could not be found. Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 939d201c-6bc3-470f-9488-acd5f3ed99fd could not be found. Aug 18 17:11:06.070501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:06.073797 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] Returning 404 to user: Instance 939d201c-6bc3-470f-9488-acd5f3ed99fd could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:11:06.073797 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f900ef33-6c3f-4955-a83d-ec3956546697 tempest-ServerRescueNegativeTestJSON-1503052600 tempest-ServerRescueNegativeTestJSON-1503052600-project] 10.222.0.78 "GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd" status: 404 len: 111 microversion: 2.1 time: 0.031351 Aug 18 17:11:06.073797 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 393/742] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:06 2022] GET /compute/v2.1/servers/939d201c-6bc3-470f-9488-acd5f3ed99fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:11:06.761008 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-bfd70cb5-9953-47ff-80e1-f8825c28c979 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:06.764443 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-bfd70cb5-9953-47ff-80e1-f8825c28c979 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:06.772627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bfd70cb5-9953-47ff-80e1-f8825c28c979 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:06.773222 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bfd70cb5-9953-47ff-80e1-f8825c28c979 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:06.773727 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bfd70cb5-9953-47ff-80e1-f8825c28c979 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:06.774433 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bfd70cb5-9953-47ff-80e1-f8825c28c979 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:06.774919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bfd70cb5-9953-47ff-80e1-f8825c28c979 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:06.775404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bfd70cb5-9953-47ff-80e1-f8825c28c979 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:06.809559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-bfd70cb5-9953-47ff-80e1-f8825c28c979 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054017 Aug 18 17:11:06.810393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 350/743] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:11:06 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:07.006998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:07.007530 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:07.013547 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:07.014293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:07.014724 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:07.015411 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:07.015898 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:07.016321 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:07.238545 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:07.238545 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:07.243041 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:07.243579 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:07.244012 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:07.244926 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:07.245388 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:07.245835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:07.273879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:07.282325 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7e6c275f-5e66-4148-8710-39a277506e35 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.279317 Aug 18 17:11:07.283400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 394/744] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:07 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:07.337411 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lazy-loading 'services' on Instance uuid 098c14b1-7597-4367-b573-ce4c70d7988e {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:11:07.539484 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-efed1d03-45dd-45e5-84cd-dcd3da3a7924 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "DELETE /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e/os-volume_attachments/30854c34-c279-4c87-be0c-8e497cbede36" status: 202 len: 0 microversion: 2.1 time: 0.306817 Aug 18 17:11:07.540021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 351/745] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:11:07 2022] DELETE /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e/os-volume_attachments/30854c34-c279-4c87-be0c-8e497cbede36 => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:11:07.822799 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c6670480-b348-4587-bb81-757f2af1107b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:07.825988 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c6670480-b348-4587-bb81-757f2af1107b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:07.832318 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c6670480-b348-4587-bb81-757f2af1107b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:07.832940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c6670480-b348-4587-bb81-757f2af1107b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:07.834213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c6670480-b348-4587-bb81-757f2af1107b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:07.834332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c6670480-b348-4587-bb81-757f2af1107b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:07.834775 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c6670480-b348-4587-bb81-757f2af1107b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:07.835207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c6670480-b348-4587-bb81-757f2af1107b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:07.867117 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c6670480-b348-4587-bb81-757f2af1107b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048688 Aug 18 17:11:07.868079 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 395/746] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:11:07 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:11:07.940051 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:07.940731 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:07.947560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:07.948125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:07.948571 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:07.950202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:07.950202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:07.950372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:07.977036 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:11:08.013474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:08.304866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:08.305534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:08.308005 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:08.312855 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:08.313343 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:08.314361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:08.315220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:08.315708 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:08.316137 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:08.323028 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-17d4223f-9589-42ee-8895-3b72473f7c5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 204 len: 0 microversion: 2.1 time: 0.387618 Aug 18 17:11:08.326062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 352/747] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:11:07 2022] DELETE /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 18 17:11:08.332164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:08.332870 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:08.335406 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:08.338936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:08.339425 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:08.339894 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:08.340592 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:08.341044 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:08.341471 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:08.482901 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:08.491331 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-dfb93c61-16a9-41b1-b67e-92c2f0c82bf9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1683 microversion: 2.1 time: 0.163162 Aug 18 17:11:08.491947 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 353/748] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:08 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:08.647875 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:08.656964 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cfc15c63-ce18-4e5e-8168-41ed6cc710f7 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.356012 Aug 18 17:11:08.657573 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 396/749] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:08 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:08.671218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:08.671857 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:08.677922 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:08.678410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:08.678851 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:08.679581 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:08.680036 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:08.680695 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:08.707490 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:11:09.042879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-53dbc282-9e01-436a-b21c-f734a3dd4474 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "DELETE /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 204 len: 0 microversion: 2.1 time: 0.375342 Aug 18 17:11:09.043574 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 354/750] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:11:08 2022] DELETE /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:11:09.052423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:09.053207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:09.059744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:09.060231 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:09.060663 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:09.061363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:09.061824 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:09.062243 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:09.417964 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:09.426810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ea8a4454-22de-4363-ad63-6dafc55f548c tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1558 microversion: 2.1 time: 0.378661 Aug 18 17:11:09.427383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 397/751] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:09 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1558 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:09.518349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:09.519162 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:09.526468 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:09.527083 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:09.527796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:09.528585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:09.529151 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:09.529620 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:09.682679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:09.682679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:09.686875 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:09.687359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:09.688313 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:09.689618 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:09.690248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:09.691175 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:09.733777 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:09.742540 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2c6a4575-d7f1-46d8-8836-41e13ca76238 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1683 microversion: 2.1 time: 0.232909 Aug 18 17:11:09.743145 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 355/752] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:09 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1683 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:09.848209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:09.856327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b39b42c9-7665-4a25-9805-a4c86c300405 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.180583 Aug 18 17:11:09.870276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 398/753] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:09 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:10.447145 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:10.447791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:10.454263 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:10.454742 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:10.455175 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:10.455885 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:10.456338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:10.456763 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:10.600429 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:10.608144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2d176814-3c77-48ca-b62e-7229120a02e2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1512 microversion: 2.1 time: 0.164940 Aug 18 17:11:10.608715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 356/754] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:10 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1512 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:10.764501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:10.765742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:10.773216 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:10.773708 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:10.774149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:10.774887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:10.775400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:10.775864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:10.877694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:10.878314 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:10.880507 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=1,nova_api:UPDATE=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:10.887203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:10.887731 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:10.888173 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:10.889141 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:10.889595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:10.890019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:10.915429 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:10.923934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-60f5848a-9143-4ef5-99f6-8cada6ea610e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1683 microversion: 2.1 time: 0.163093 Aug 18 17:11:10.928723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 399/755] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:10 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1683 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:11.049100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:11.056161 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d5b70fa2-e5e7-4715-a639-b1cf47ad4985 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.182409 Aug 18 17:11:11.056819 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 357/756] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:10 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:11.638897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:11.639472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:11.645585 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:11.648841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:11.648841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:11.648841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:11.648841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:11.649215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:11.800156 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:11.808113 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-61b58d32-6181-4883-9014-208acff5a355 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1512 microversion: 2.1 time: 0.173931 Aug 18 17:11:11.808689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 400/757] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:11 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1512 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:11.945636 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:11.946644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:11.953443 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:11.953929 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:11.954393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:11.955095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:11.955572 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:11.956002 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:12.083077 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:12.084098 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:12.092500 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:12.094058 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:12.094683 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:12.096837 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:12.097980 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:12.098732 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:12.099376 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:12.101641 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9f1aff70-d996-484d-8e42-4aad3a8589ab tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1683 microversion: 2.1 time: 0.159744 Aug 18 17:11:12.102241 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 358/758] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:11 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1683 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:12.401517 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:12.413202 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f3ecdc44-3b57-4900-b2c4-a700234bc8b0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.337004 Aug 18 17:11:12.427886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 401/759] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:12 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:12.781912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-1821b038-7a0c-48de-a610-c70c494ce8a1 req-a0ef38bf-7382-4dcf-932a-b48fb2b758ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "098c14b1-7597-4367-b573-ce4c70d7988e", "name": "network-vif-deleted", "tag": "c4d87ed4-61d5-4e83-b65f-60b75d845742"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:12.796403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-1821b038-7a0c-48de-a610-c70c494ce8a1 req-a0ef38bf-7382-4dcf-932a-b48fb2b758ed service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:12.797148 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-1821b038-7a0c-48de-a610-c70c494ce8a1 req-a0ef38bf-7382-4dcf-932a-b48fb2b758ed service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:12.798301 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-1821b038-7a0c-48de-a610-c70c494ce8a1 req-a0ef38bf-7382-4dcf-932a-b48fb2b758ed service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:12.810880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-1821b038-7a0c-48de-a610-c70c494ce8a1 req-a0ef38bf-7382-4dcf-932a-b48fb2b758ed service nova] Creating event network-vif-deleted:c4d87ed4-61d5-4e83-b65f-60b75d845742 for instance 098c14b1-7597-4367-b573-ce4c70d7988e on hv-cinder-85367 Aug 18 17:11:12.818266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-1821b038-7a0c-48de-a610-c70c494ce8a1 req-a0ef38bf-7382-4dcf-932a-b48fb2b758ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174274 Aug 18 17:11:12.819296 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 359/760] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:12.830026 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:12.830644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:12.838635 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:12.839133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:12.844943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:12.844943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:12.844943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:12.844943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:12.918679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:12.926700 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-02e1f6ce-712c-440d-b587-46cc0e5114da tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1303 microversion: 2.1 time: 0.100528 Aug 18 17:11:12.927853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 402/761] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:12 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:13.123580 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:13.124544 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:13.132738 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:13.133256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:13.133735 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:13.134395 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:13.134849 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:13.135265 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:13.202251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:13.210690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f4d7272f-c484-41bd-a321-6896eb8ce6d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1615 microversion: 2.1 time: 0.092081 Aug 18 17:11:13.211421 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 360/762] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:13 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1615 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:13.376267 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-7954b85e-72c5-4cb1-a5db-cf28f70e8324 req-02e9a233-7534-4eb1-8ba2-eff6f2930ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da756d85-46a8-4afd-bfbc-4e20051f6d10", "name": "network-vif-deleted", "tag": "c333bfe5-da42-42cd-bf47-8e1f436f482b"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:13.390409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-7954b85e-72c5-4cb1-a5db-cf28f70e8324 req-02e9a233-7534-4eb1-8ba2-eff6f2930ea3 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:13.391143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-7954b85e-72c5-4cb1-a5db-cf28f70e8324 req-02e9a233-7534-4eb1-8ba2-eff6f2930ea3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:13.392147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-7954b85e-72c5-4cb1-a5db-cf28f70e8324 req-02e9a233-7534-4eb1-8ba2-eff6f2930ea3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:13.405136 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-7954b85e-72c5-4cb1-a5db-cf28f70e8324 req-02e9a233-7534-4eb1-8ba2-eff6f2930ea3 service nova] Creating event network-vif-deleted:c333bfe5-da42-42cd-bf47-8e1f436f482b for instance da756d85-46a8-4afd-bfbc-4e20051f6d10 on hv-cinder-85367 Aug 18 17:11:13.411188 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-7954b85e-72c5-4cb1-a5db-cf28f70e8324 req-02e9a233-7534-4eb1-8ba2-eff6f2930ea3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038551 Aug 18 17:11:13.416221 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 403/763] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:13.438060 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:13.438741 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:13.460564 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:13.461071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:13.462448 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:13.463571 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:13.466874 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:13.469315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:13.675872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:13.691026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-adf57fa2-caf6-4af1-9c53-ef68f73eaffd tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.257351 Aug 18 17:11:13.692444 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 361/764] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:13 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:13.951371 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:13.952286 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:13.960184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:13.960786 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:13.961311 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:13.962107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:13.962739 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:13.963266 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:13.997350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:13.997947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:13.998446 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:13.998990 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lazy-loading 'fault' on Instance uuid 098c14b1-7597-4367-b573-ce4c70d7988e {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:11:14.073835 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff492aa3ff514be8a7bfebdf8241e79a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '50036d9fc240431fbcd0b75ed17248fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:14.084197 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-55112671-7160-4604-ae00-99cadc295d11 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 200 len: 1308 microversion: 2.1 time: 0.139890 Aug 18 17:11:14.088212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 404/765] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:13 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 1308 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:14.231661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:14.232731 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:14.239453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:14.239957 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:14.240389 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:14.241136 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:14.241615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:14.242056 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:14.274956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:14.275470 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:14.275905 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:14.276352 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid da756d85-46a8-4afd-bfbc-4e20051f6d10 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:11:14.317110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:14.324823 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-42eb2212-5458-4f2b-8faa-c5a450b0f7f6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 200 len: 1332 microversion: 2.1 time: 0.097128 Aug 18 17:11:14.325314 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 362/766] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:14 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:14.712717 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:14.714318 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:14.721207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:14.722044 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:14.722708 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:14.723978 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:14.724678 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:14.725480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:14.864865 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:14.872625 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5e7353e4-f5c0-4fcd-a0b2-6e7c3928f205 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.163788 Aug 18 17:11:14.873196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 405/767] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:14 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:15.108088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:15.108703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] [instance: 098c14b1-7597-4367-b573-ce4c70d7988e] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:15.114728 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:15.115143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:15.115607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:15.116300 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:15.116755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:15.117178 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:15.131487 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] HTTP exception thrown: Instance 098c14b1-7597-4367-b573-ce4c70d7988e could not be found. Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Request method failure captured: Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e HTTP/1.1 Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nIind8RO-1kRzAOuSQDNEZeleO0H1-mbUfLfhRj4Yb_VE83nq0WKLBckfZFbVff8OjycjBCX0qkQ_kV--CftyvUgGr38ELqz02p1DC7ay9BeIR_8a0HA1m4ax17fKZMNiAat8a8aVc4pwB-6kXcCr0xaOAD4LrLf93vUf0SBwc2-lY Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 50036d9fc240431fbcd0b75ed17248fd Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesSnapshotTestJSON-346599018 Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:11:15.133110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/50036d9fc240431fbcd0b75ed17248fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/50036d9fc240431fbcd0b75ed17248fd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/50036d9fc240431fbcd0b75ed17248fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_50036d9fc240431fbcd0b75ed17248fd", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesSnapshotTestJSON-346599018 Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 50036d9fc240431fbcd0b75ed17248fd Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-346599018 Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesSnapshotTestJSON-346599018-project Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: ff492aa3ff514be8a7bfebdf8241e79a Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesSnapshotTestJSON-346599018-project Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 098c14b1-7597-4367-b573-ce4c70d7988e could not be found. Aug 18 17:11:15.134734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '098c14b1-7597-4367-b573-ce4c70d7988e'} Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 098c14b1-7597-4367-b573-ce4c70d7988e could not be found. Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:11:15.135668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 098c14b1-7597-4367-b573-ce4c70d7988e could not be found. Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 098c14b1-7597-4367-b573-ce4c70d7988e could not be found. Aug 18 17:11:15.137365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.138945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] Returning 404 to user: Instance 098c14b1-7597-4367-b573-ce4c70d7988e could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:11:15.138945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6b24a6fa-dadc-4c36-8791-8360b11828a2 tempest-VolumesSnapshotTestJSON-346599018 tempest-VolumesSnapshotTestJSON-346599018-project] 10.222.0.78 "GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e" status: 404 len: 111 microversion: 2.1 time: 0.030265 Aug 18 17:11:15.138945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 363/768] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:15 2022] GET /compute/v2.1/servers/098c14b1-7597-4367-b573-ce4c70d7988e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:11:15.347000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:15.347643 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:15.354292 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:15.354975 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:15.355505 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:15.356279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:15.356806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:15.357447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:15.374666 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 HTTP/1.1 Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:11:15.377830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:11:15.379640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': 'da756d85-46a8-4afd-bfbc-4e20051f6d10'} Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:11:15.380534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:11:15.381946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:15.383241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:11:15.383241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-286bad48-29cc-43ef-81ea-8504b51fc5a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 404 len: 111 microversion: 2.1 time: 0.038153 Aug 18 17:11:15.383241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 406/769] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:15 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:11:15.390273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4d1a2c44-25de-4bbf-9795-a61876fe516f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '.version_select at 0x7ff5b4dcf310>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:15.513286 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4d1a2c44-25de-4bbf-9795-a61876fe516f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240512152" status: 202 len: 0 microversion: 2.1 time: 0.127059 Aug 18 17:11:15.517023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 364/770] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Aug 18 17:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1240512152 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:11:15.897745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:15.899117 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:15.909095 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:15.909946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:15.910915 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:15.912088 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:15.912853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:15.913356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:16.155747 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:16.170529 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a94d9bcc-7769-4047-8be9-70576bf16c79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.279025 Aug 18 17:11:16.175100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 407/771] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:15 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:16.547040 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-631a6e9e-64fa-4681-b8df-4f371c184f62 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: .version_select at 0x7ff5b4ce2160>, body: {"keypair": {"name": "tempest-keypair-1675144905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFz9yBX6NSrS7GY813wCRWqnEoRhNx5k31fFmyEOd21FxJDbQupo5imskjO80wBNZigEU7nMzTJC452pmaBbmK0aEdKsvvKqCOk6YU7zbnu/llPeVaPXo6x7YeLwNr08UQ=="}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:16.566545 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-631a6e9e-64fa-4681-b8df-4f371c184f62 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for project 4eececcd804446e49078038ab362b235. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:11:16.570790 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-631a6e9e-64fa-4681-b8df-4f371c184f62 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for user 1fec6bdfe9ee4e839efaf7a1c083c31d and project 4eececcd804446e49078038ab362b235. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:11:16.695936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-631a6e9e-64fa-4681-b8df-4f371c184f62 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.152937 Aug 18 17:11:16.697382 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 365/772] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:11:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:17.205767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:17.212683 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:17.223239 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:17.223239 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:17.223239 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:17.223239 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:17.223649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:17.224244 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:17.702204 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:17.711752 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0f5b1ebd-7b0e-4e0b-9ac3-689acbc43458 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.521258 Aug 18 17:11:17.712912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 408/773] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:17 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:18.734554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:18.736387 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:18.743549 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:18.744130 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:18.744565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:18.745310 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:18.745795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:18.746223 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:18.918717 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:18.929049 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1db138c0-228a-43e9-bcb2-a9c6094f59fa tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1507 microversion: 2.1 time: 0.198318 Aug 18 17:11:18.933921 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 366/774] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:18 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1507 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:18.951046 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:18.951786 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:18.959278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:18.962540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:18.962540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:18.962540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:18.962540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:18.962921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:19.070958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121267) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 17:11:19.387116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-083acb88-2fef-4339-8027-4a39e0f94e63 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "POST /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1/action" status: 202 len: 0 microversion: 2.1 time: 0.440285 Aug 18 17:11:19.388636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 409/775] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:11:18 2022] POST /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1/action => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:11:19.397210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:19.397831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:19.406472 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:19.407864 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:19.408538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:19.409500 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:19.410189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:19.410902 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:19.644022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:19.654112 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e527fe22-d855-4e86-95e2-be491c589b79 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1515 microversion: 2.1 time: 0.260774 Aug 18 17:11:19.667588 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 367/776] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:19 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1515 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:20.177869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-539058475", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "93c53d22-e6a6-4bb0-95db-6f41b7bca33b"}], "security_groups": [{"name": "tempest-securitygroup--123815723"}], "key_name": "tempest-keypair-1675144905", "user_data": "}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:20.243174 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fc6df416-dab4-411e-bd2a-e3771ef15ce7 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'create', calling method: .version_select at 0x7ff5b4ca8280>, body: {"keypair": {"name": "tempest-keypair-2003315310", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4QOmG+oPRSBKglEN5m6G76oji0eavYe97wZzkT7/zsYMZ7b3HNzcrTzRWKmnF2h4kiM3vR/1KbVF9N2PQBOCLAp23qZBkuoM1icp8iegfSq4fiXUSt7VFA/am/25vCuw=="}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:20.264774 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-fc6df416-dab4-411e-bd2a-e3771ef15ce7 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Getting quotas for project 44e1819d40894e26bfbe20d58589823f. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:11:20.271225 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-fc6df416-dab4-411e-bd2a-e3771ef15ce7 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Getting quotas for user d909457b883345c982916c842926836d and project 44e1819d40894e26bfbe20d58589823f. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:11:20.308985 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.network.neutron [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] validate_networks() for [('93c53d22-e6a6-4bb0-95db-6f41b7bca33b', None, None, None, None, None)] {{(pid=121267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:11:20.357242 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fc6df416-dab4-411e-bd2a-e3771ef15ce7 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.174827 Aug 18 17:11:20.363973 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 368/777] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:11:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:11:20.672483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-ad5ab380-94f6-40d3-911e-a72395cdb3e7 req-ccb211a4-c6a0-4954-ad96-68247c2a7505 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1", "name": "network-vif-unplugged", "status": "completed", "tag": "60e0cf05-5e8f-4133-8579-da77a04a4d8a"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:20.697131 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ad5ab380-94f6-40d3-911e-a72395cdb3e7 req-ccb211a4-c6a0-4954-ad96-68247c2a7505 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:20.698141 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ad5ab380-94f6-40d3-911e-a72395cdb3e7 req-ccb211a4-c6a0-4954-ad96-68247c2a7505 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:20.698920 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ad5ab380-94f6-40d3-911e-a72395cdb3e7 req-ccb211a4-c6a0-4954-ad96-68247c2a7505 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:20.727856 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.compute.server_external_events [req-ad5ab380-94f6-40d3-911e-a72395cdb3e7 req-ccb211a4-c6a0-4954-ad96-68247c2a7505 service nova] Unable to find a host for instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1. Dropping event network-vif-unplugged {{(pid=121268) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 17:11:20.731858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-ad5ab380-94f6-40d3-911e-a72395cdb3e7 req-ccb211a4-c6a0-4954-ad96-68247c2a7505 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.165832 Aug 18 17:11:20.737252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 369/778] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 172 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 18 17:11:20.761352 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:20.762349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:20.772834 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:20.773720 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:20.774516 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:20.775431 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Flavor limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:11:20.775686 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:20.775880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Image limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:11:20.777232 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Flavor pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:11:20.778047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Image pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:11:20.779612 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:20.779742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:11:20.780518 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:20.799342 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:20.799856 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:20.800899 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:20.801851 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:20.802468 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:20.803040 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:20.825893 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for project 4eececcd804446e49078038ab362b235. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:11:20.831290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Getting quotas for user 1fec6bdfe9ee4e839efaf7a1c083c31d and project 4eececcd804446e49078038ab362b235. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:11:20.846497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Going to run 1 instances... {{(pid=121267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:11:20.850517 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:11:20.939692 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:20.947408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-53257545-8d16-4e3c-a592-01cb80291888 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1517 microversion: 2.1 time: 0.197790 Aug 18 17:11:20.948088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 370/779] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:20 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1517 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:20.981388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-59b318cb-d1df-4d22-a666-61cd97e8d1d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.809671 Aug 18 17:11:20.982473 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 410/780] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:11:20 2022] POST /compute/v2.1/servers => generated 401 bytes in 811 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 18 17:11:20.993981 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0af9cbde-a6d9-4d56-b3c4-1de5c0d7ee8a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:20.994781 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0af9cbde-a6d9-4d56-b3c4-1de5c0d7ee8a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:21.062689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0af9cbde-a6d9-4d56-b3c4-1de5c0d7ee8a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:21.071853 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0af9cbde-a6d9-4d56-b3c4-1de5c0d7ee8a tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1241 microversion: 2.1 time: 0.082009 Aug 18 17:11:21.073058 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 371/781] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:20 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1241 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:21.971814 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:21.973066 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:21.985979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:21.987174 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:21.989638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:21.989850 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:21.990542 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:21.991033 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:22.095954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:22.096585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:22.108152 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:22.108962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:22.112499 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:22.112499 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:22.112499 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:22.112499 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:22.141223 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:22.198174 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:22.207336 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c5ddf0a8-4497-49df-b021-7c24c180641c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1517 microversion: 2.1 time: 0.241039 Aug 18 17:11:22.211124 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:22.220487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 411/782] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:21 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1517 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:22.222722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-496ccb98-1265-43be-9ce5-8ab989c15ab2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1245 microversion: 2.1 time: 0.132187 Aug 18 17:11:22.223838 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 372/783] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:22 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1245 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:23.230125 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:23.230743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:23.237536 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:23.239593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:23.240252 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:23.241136 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:23.241805 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:23.242393 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:23.245237 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:23.246453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:23.255159 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:23.255884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:23.256585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:23.257560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:23.258209 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:23.258948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:23.346540 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:23.355226 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-bc006df7-d23c-445c-bf20-0da602f01d5c tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1293 microversion: 2.1 time: 0.114529 Aug 18 17:11:23.382837 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 373/784] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:23 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1293 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:23.407584 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:23.423250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-19f02096-3bc4-4f6e-a4b8-2188aee79d47 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.194055 Aug 18 17:11:23.437087 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 412/785] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:23 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:23.441467 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-278093685", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e79ee218-b8f4-4366-b86f-915853fc6747"}], "security_groups": [{"name": "tempest-securitygroup--1128334041"}], "key_name": "tempest-keypair-2003315310", "user_data": "}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:23.688637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] validate_networks() for [('e79ee218-b8f4-4366-b86f-915853fc6747', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:11:24.257491 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:11:24.258133 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:11:24.258591 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:11:24.259001 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:11:24.259414 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:11:24.268565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:24.269051 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:24.269629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:24.270397 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:24.270848 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:24.271603 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:24.289847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Getting quotas for project 44e1819d40894e26bfbe20d58589823f. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:11:24.294037 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Getting quotas for user d909457b883345c982916c842926836d and project 44e1819d40894e26bfbe20d58589823f. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:11:24.306279 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:11:24.308622 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:11:24.390445 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:24.391083 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:24.397347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:24.397825 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:24.398345 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:24.399035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:24.399528 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:24.400023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:24.428825 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-211bc6c6-7412-453e-9f1e-414d808cd96d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.013410 Aug 18 17:11:24.435496 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 374/786] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:11:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1023 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:11:24.440372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-14dace0f-43a4-441e-a478-4c66cc497bb1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:24.441240 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-14dace0f-43a4-441e-a478-4c66cc497bb1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:24.468686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:24.473392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:24.479123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5d6aeada-a9d9-48f9-b3ce-91fb7376874b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1299 microversion: 2.1 time: 0.093216 Aug 18 17:11:24.479790 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 413/787] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:24 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1299 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:24.484702 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:24.486153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:24.492226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:24.493016 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:24.493537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:24.494403 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:24.494933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:24.495602 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:24.539882 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-14dace0f-43a4-441e-a478-4c66cc497bb1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:24.552688 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-14dace0f-43a4-441e-a478-4c66cc497bb1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1237 microversion: 2.1 time: 0.115966 Aug 18 17:11:24.553570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 375/788] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:24 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1237 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:24.664765 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:24.673117 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d47e41bf-fd8f-4ba6-bd9c-b8b40c15d752 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.191449 Aug 18 17:11:24.673700 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 414/789] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:24 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:25.505979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:25.506738 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:25.515243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:25.516771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:25.519431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:25.519431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:25.519431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:25.519431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:25.574414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-07cf7713-758b-45bc-830e-a59b36dcaa4a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:25.576982 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-07cf7713-758b-45bc-830e-a59b36dcaa4a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:25.633241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-07cf7713-758b-45bc-830e-a59b36dcaa4a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:25.644744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-07cf7713-758b-45bc-830e-a59b36dcaa4a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1237 microversion: 2.1 time: 0.071051 Aug 18 17:11:25.654835 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 415/790] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:25 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1237 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:25.694798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:25.695757 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:25.696512 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:25.703345 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:25.704100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:25.719762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:25.719762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:25.719762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:25.719762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:25.720256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e5b72ca5-26f7-466f-9923-845fed2f5f04 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.207106 Aug 18 17:11:25.720256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 376/791] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:25 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:25.865867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:25.873969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7c15be43-43dd-42db-af40-c7b74a2651f3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.182904 Aug 18 17:11:25.874759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 416/792] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:25 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:25.940010 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-75e34332-4b7e-43b2-bd44-897fadcf0f16 req-7ba52781-0a0a-43e2-83f4-9c6631711f75 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe34c884-f87c-410a-a740-30046200620f", "tag": "163f8304-d484-49c9-8968-b436b23114d7"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:25.949658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-75e34332-4b7e-43b2-bd44-897fadcf0f16 req-7ba52781-0a0a-43e2-83f4-9c6631711f75 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:25.950134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-75e34332-4b7e-43b2-bd44-897fadcf0f16 req-7ba52781-0a0a-43e2-83f4-9c6631711f75 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:25.950572 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-75e34332-4b7e-43b2-bd44-897fadcf0f16 req-7ba52781-0a0a-43e2-83f4-9c6631711f75 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:25.962961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-75e34332-4b7e-43b2-bd44-897fadcf0f16 req-7ba52781-0a0a-43e2-83f4-9c6631711f75 service nova] Creating event network-changed:163f8304-d484-49c9-8968-b436b23114d7 for instance fe34c884-f87c-410a-a740-30046200620f on hv-cinder-85367 Aug 18 17:11:25.968319 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-75e34332-4b7e-43b2-bd44-897fadcf0f16 req-7ba52781-0a0a-43e2-83f4-9c6631711f75 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032209 Aug 18 17:11:25.968957 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 377/793] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:26.662870 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:26.663607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:26.669636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:26.670265 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:26.670791 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:26.671679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:26.672229 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:26.672882 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:26.740839 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:26.740839 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:26.744973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:26.747769 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:26.748337 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:26.748849 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:26.749677 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:26.750209 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:26.750712 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:26.766978 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-20ae1eb3-068d-4346-974a-5467ad5bac6f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1289 microversion: 2.1 time: 0.107333 Aug 18 17:11:26.768319 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 417/794] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:26 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:26.897469 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:26.904346 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:26.911975 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:26.912574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:26.913417 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:26.914158 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:26.914740 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:26.915281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:27.169897 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:27.181267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ec22d950-4d15-4bbb-a71a-3de143683728 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.450564 Aug 18 17:11:27.182962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 378/795] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:26 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:27.191256 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:27.202387 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-84b0abd4-12c7-4955-8e5e-9bb4b39b2e5f tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.309531 Aug 18 17:11:27.204448 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 418/796] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:26 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:27.789898 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:27.790508 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:27.797071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:27.797554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:27.798009 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:27.798703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:27.800033 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:27.800033 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:27.862229 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:27.869926 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1f7dae9b-a3f6-4130-954d-8498fa24b664 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1295 microversion: 2.1 time: 0.083879 Aug 18 17:11:27.870493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 379/797] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:27 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1295 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:28.202277 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:28.202911 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:28.209572 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:28.210059 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:28.210502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:28.211203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:28.211695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:28.212125 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:28.224828 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:28.225433 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:28.231280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:28.231795 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:28.232276 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:28.232918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:28.233384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:28.233830 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:28.357707 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:28.366103 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9dc4e466-5cb1-4ddc-808a-bbd9be109843 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.167716 Aug 18 17:11:28.366863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 419/798] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:28 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:28.378970 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:28.386722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-bf736f56-8360-463f-a27e-c6a9bc5aa5e0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.165670 Aug 18 17:11:28.387287 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 380/799] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:28 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:28.892400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:28.892956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:28.899055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:28.899576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:28.900011 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:28.900710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:28.901165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:28.901585 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:29.035902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:29.044233 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bdf99388-2b7b-4d14-8275-3caa01c2d8fa tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.156586 Aug 18 17:11:29.044821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 420/800] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:28 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:29.387463 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:29.388350 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:29.395502 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:29.396001 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:29.396441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:29.397142 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:29.397600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:29.398022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:29.410056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:29.410665 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:29.416991 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:29.417477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:29.417911 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:29.418605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:29.419073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:29.419510 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:29.531347 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:29.542075 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-af0336ad-4d5f-465b-8156-a053a9aacb56 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.158343 Aug 18 17:11:29.542719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 381/801] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:29 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:29.566686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:29.574507 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a4e954cc-4235-4c1c-9e2a-45189b0aa036 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.168302 Aug 18 17:11:29.575074 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 421/802] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:29 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:30.065453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:30.066077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:30.072212 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:30.072704 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:30.073143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:30.073845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:30.074356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:30.074761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:30.207226 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:30.214831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-176599a8-42ea-4c3b-a8dd-3fc070cc2bcf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.154089 Aug 18 17:11:30.215408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 382/803] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:30 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:30.564144 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:30.564809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:30.571389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:30.571914 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:30.572365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:30.573066 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:30.573527 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:30.573951 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:30.596681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:30.597303 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:30.603939 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:30.604493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:30.604935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:30.605640 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:30.606098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:30.606525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:30.707029 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:30.714612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cda907b4-45cb-4bc9-995b-5c88ce33c7d3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.154991 Aug 18 17:11:30.715166 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 422/804] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:30 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:30.739727 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:30.747558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-93659609-df2d-4f5a-84df-fbb1a6a09e2b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.155736 Aug 18 17:11:30.748063 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 383/805] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:30 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:31.236647 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:31.237300 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:31.240841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:31.244384 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:31.244882 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:31.245322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:31.246031 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:31.246493 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:31.247147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:31.412062 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:31.421034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2693a3ea-5a5b-45e6-a623-646670f3519a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.188923 Aug 18 17:11:31.434343 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 423/806] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:31 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:31.694140 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-10739253-efb4-4648-808b-9f95eb261fb3 req-6926525b-e18f-4f0a-940e-c6e2b6df3ecf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08626bd0-6047-4258-a83d-efb24d789f0d", "tag": "73b593a6-2fae-4e85-9374-fafccac8c7ac"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:31.708520 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-10739253-efb4-4648-808b-9f95eb261fb3 req-6926525b-e18f-4f0a-940e-c6e2b6df3ecf service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:31.709210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-10739253-efb4-4648-808b-9f95eb261fb3 req-6926525b-e18f-4f0a-940e-c6e2b6df3ecf service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:31.709803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-10739253-efb4-4648-808b-9f95eb261fb3 req-6926525b-e18f-4f0a-940e-c6e2b6df3ecf service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:31.723251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-10739253-efb4-4648-808b-9f95eb261fb3 req-6926525b-e18f-4f0a-940e-c6e2b6df3ecf service nova] Creating event network-changed:73b593a6-2fae-4e85-9374-fafccac8c7ac for instance 08626bd0-6047-4258-a83d-efb24d789f0d on hv-cinder-85367 Aug 18 17:11:31.728919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-10739253-efb4-4648-808b-9f95eb261fb3 req-6926525b-e18f-4f0a-940e-c6e2b6df3ecf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038918 Aug 18 17:11:31.729695 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 384/807] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:31.736199 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:31.737439 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:31.743905 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:31.744619 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:31.745061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:31.745767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:31.746221 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:31.746810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:31.768886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:31.769607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:31.777908 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=5 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:31.800003 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:31.800570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:31.801020 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:31.801805 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:31.802277 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:31.802712 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:31.949082 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:31.959077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8dd7cfd2-c988-42b5-9c70-dbe2c2b4616d tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.194397 Aug 18 17:11:31.959820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 385/808] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:31 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:31.964655 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-680064005"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:31.965197 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:31.978866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:31.978866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:31.978866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:31.978866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:31.979245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:31.979245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:32.084189 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:32.093711 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-88ea4f1b-5f1a-4b55-b170-e1ededb080e8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.361564 Aug 18 17:11:32.098417 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 424/809] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:31 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:32.126964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.network.security_group_api [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Removing security group 3a082a5f-d965-424a-923f-393a462e2d5f from port 2ee00035-edc8-4a51-89b1-4dc0e2c5a468 Aug 18 17:11:32.442690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:32.444632 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:32.452871 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:32.453452 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:32.453953 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:32.454743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:32.455264 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:32.456308 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:32.561148 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e6ede25f-adcc-4049-9b88-59fa29ea66a4 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "POST /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/action" status: 202 len: 0 microversion: 2.1 time: 0.599767 Aug 18 17:11:32.561999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 386/810] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:11:31 2022] POST /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/action => generated 0 bytes in 601 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:11:32.572669 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-c1548923-ecf0-47e7-bc8d-a2cf89d297c4 req-ba927544-588e-48c6-9ebc-738d3f075efe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c79a7d-abff-4d4f-aecc-309441c5e3bc", "tag": "2ee00035-edc8-4a51-89b1-4dc0e2c5a468"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:32.587393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-c1548923-ecf0-47e7-bc8d-a2cf89d297c4 req-ba927544-588e-48c6-9ebc-738d3f075efe service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:32.588593 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-c1548923-ecf0-47e7-bc8d-a2cf89d297c4 req-ba927544-588e-48c6-9ebc-738d3f075efe service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:32.589299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-c1548923-ecf0-47e7-bc8d-a2cf89d297c4 req-ba927544-588e-48c6-9ebc-738d3f075efe service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:32.609234 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-c1548923-ecf0-47e7-bc8d-a2cf89d297c4 req-ba927544-588e-48c6-9ebc-738d3f075efe service nova] Creating event network-changed:2ee00035-edc8-4a51-89b1-4dc0e2c5a468 for instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc on hv-cinder-85367 Aug 18 17:11:32.616210 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-c1548923-ecf0-47e7-bc8d-a2cf89d297c4 req-ba927544-588e-48c6-9ebc-738d3f075efe service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047585 Aug 18 17:11:32.617722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 387/811] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:32.745502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:32.759905 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9814337f-b9e2-418a-bf12-6c97199642d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.321820 Aug 18 17:11:32.774107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 425/812] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:32 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:32.986966 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:32.987701 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:32.994647 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:32.995139 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:32.995605 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:32.996313 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:32.996773 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:32.997201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:33.117722 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:33.118350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:33.124397 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:33.125073 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:33.125451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:33.126160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:33.126800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:33.127761 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:33.170579 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:33.180204 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f69464a5-a8c0-468a-a59c-e6a4c3b047e9 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.197488 Aug 18 17:11:33.195556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 388/813] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:32 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:33.385907 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:33.395093 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4641c8e8-ab68-477d-8c5c-3137764a9584 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.281299 Aug 18 17:11:33.396008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 426/814] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:33 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:33.785816 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:33.790154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:33.794190 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:33.794894 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:33.795586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:33.796639 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:33.797291 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:33.797923 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.036911 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:34.045430 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e3a6f4c2-bdb6-4262-ad2d-faf80f86965e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.267328 Aug 18 17:11:34.046224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 389/815] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:33 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:34.206939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:34.207598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:34.214659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:34.215153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:34.215768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.216373 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:34.217009 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:34.217617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.417570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:34.418598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:34.423212 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:34.434751 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:34.435500 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:34.436751 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.441031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:34.441031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:34.441031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.472703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:34.481071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ad69ab7b-7c3b-406f-9ea6-775ec7a29b95 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.278559 Aug 18 17:11:34.482337 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 427/816] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:34 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:34.487492 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:34.488181 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:34.494737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:34.495472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:34.496100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.498922 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:34.499596 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:34.500252 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.549399 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=18 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:34.591589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:34.600668 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ea0ddb5a-d912-423a-9014-db9730cdfe19 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.187416 Aug 18 17:11:34.601718 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lazy-loading 'services' on Instance uuid 34c79a7d-abff-4d4f-aecc-309441c5e3bc {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:11:34.614923 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 390/817] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:34 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:34.623183 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-caaec26c-9812-40c7-8aed-9eb6842b30eb req-749ca493-1638-43ac-a872-eb02c386fe86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34c79a7d-abff-4d4f-aecc-309441c5e3bc", "tag": "2ee00035-edc8-4a51-89b1-4dc0e2c5a468"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:34.635539 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-caaec26c-9812-40c7-8aed-9eb6842b30eb req-749ca493-1638-43ac-a872-eb02c386fe86 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:34.636121 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-caaec26c-9812-40c7-8aed-9eb6842b30eb req-749ca493-1638-43ac-a872-eb02c386fe86 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:34.636636 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-caaec26c-9812-40c7-8aed-9eb6842b30eb req-749ca493-1638-43ac-a872-eb02c386fe86 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.650520 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-caaec26c-9812-40c7-8aed-9eb6842b30eb req-749ca493-1638-43ac-a872-eb02c386fe86 service nova] Creating event network-changed:2ee00035-edc8-4a51-89b1-4dc0e2c5a468 for instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc on hv-cinder-85367 Aug 18 17:11:34.657597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-caaec26c-9812-40c7-8aed-9eb6842b30eb req-749ca493-1638-43ac-a872-eb02c386fe86 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040385 Aug 18 17:11:34.658765 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 391/818] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:34.842134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ae578c5d-4869-465a-868d-62554a3c7431 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments/3fb38cdc-7668-445d-b3bb-272e214bda0d" status: 202 len: 0 microversion: 2.1 time: 0.358002 Aug 18 17:11:34.842736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 428/819] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:11:34 2022] DELETE /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments/3fb38cdc-7668-445d-b3bb-272e214bda0d => generated 0 bytes in 360 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:11:34.853870 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4350ebe7-1372-4e05-9648-b997a53c87ff tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:34.856222 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4350ebe7-1372-4e05-9648-b997a53c87ff tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:34.865643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4350ebe7-1372-4e05-9648-b997a53c87ff tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:34.866136 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4350ebe7-1372-4e05-9648-b997a53c87ff tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:34.866782 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4350ebe7-1372-4e05-9648-b997a53c87ff tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.867557 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4350ebe7-1372-4e05-9648-b997a53c87ff tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:34.868014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4350ebe7-1372-4e05-9648-b997a53c87ff tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:34.868649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4350ebe7-1372-4e05-9648-b997a53c87ff tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:34.902035 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4350ebe7-1372-4e05-9648-b997a53c87ff tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053958 Aug 18 17:11:34.906670 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 392/820] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:11:34 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:11:35.067997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:35.069049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:35.075316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:35.075857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:35.076291 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:35.077017 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:35.077583 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:35.077885 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:35.222569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:35.230414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-095ce6fb-485c-4533-a9f6-bf6067c4b347 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.167743 Aug 18 17:11:35.230987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 429/821] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:35 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:35.504798 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:35.505418 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:35.512222 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:35.512719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:35.513566 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:35.514364 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:35.514723 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:35.515203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:35.625010 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:35.625831 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:35.632892 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:35.633540 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:35.634454 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:35.635413 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:35.636070 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:35.636775 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:35.642559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=8 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:35.765811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:35.765811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=100 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:35.767060 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9d931819-0f08-4d99-b642-016889d0a2e3 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.266431 Aug 18 17:11:35.767677 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 393/822] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:35 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:35.847155 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:35.859371 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:35.864921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2e38f290-ed5e-4a02-833e-38a332260677 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.246753 Aug 18 17:11:35.866648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 430/823] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:35 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:35.914614 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-812b18b2-703e-4f23-a792-0d21cee52f2d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:35.916977 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-812b18b2-703e-4f23-a792-0d21cee52f2d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:35.933716 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812b18b2-703e-4f23-a792-0d21cee52f2d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:35.934861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812b18b2-703e-4f23-a792-0d21cee52f2d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:35.935579 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812b18b2-703e-4f23-a792-0d21cee52f2d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:35.936532 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812b18b2-703e-4f23-a792-0d21cee52f2d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:35.937309 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812b18b2-703e-4f23-a792-0d21cee52f2d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:35.937958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812b18b2-703e-4f23-a792-0d21cee52f2d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:35.982755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-812b18b2-703e-4f23-a792-0d21cee52f2d tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072256 Aug 18 17:11:35.983346 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 394/824] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:11:35 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:36.005419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-7d9bc3b3-a8a1-4cb8-ae59-fc6698833dad req-ebbae390-7cd1-43f8-8906-9806b49a80d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1", "name": "network-vif-plugged", "status": "completed", "tag": "60e0cf05-5e8f-4133-8579-da77a04a4d8a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:36.015728 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-7d9bc3b3-a8a1-4cb8-ae59-fc6698833dad req-ebbae390-7cd1-43f8-8906-9806b49a80d7 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:36.016392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-7d9bc3b3-a8a1-4cb8-ae59-fc6698833dad req-ebbae390-7cd1-43f8-8906-9806b49a80d7 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:36.017028 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-7d9bc3b3-a8a1-4cb8-ae59-fc6698833dad req-ebbae390-7cd1-43f8-8906-9806b49a80d7 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:36.029592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-7d9bc3b3-a8a1-4cb8-ae59-fc6698833dad req-ebbae390-7cd1-43f8-8906-9806b49a80d7 service nova] Creating event network-vif-plugged:60e0cf05-5e8f-4133-8579-da77a04a4d8a for instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 on hv-cinder-85367 Aug 18 17:11:36.034527 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-7d9bc3b3-a8a1-4cb8-ae59-fc6698833dad req-ebbae390-7cd1-43f8-8906-9806b49a80d7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034762 Aug 18 17:11:36.035131 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 431/825] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:11:36.252180 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:36.253648 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:36.263384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:36.265757 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:36.266361 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:36.268643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:36.271760 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:36.281699 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:36.423163 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:36.431067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1a8ea1ea-4556-4f66-8dae-6194a83677ef tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.183016 Aug 18 17:11:36.431677 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 395/826] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:36 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:36.795499 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:36.796189 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:36.802643 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:36.803116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:36.803575 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:36.804267 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:36.804716 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:36.805167 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:36.887338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:36.888481 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:36.899461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:36.900833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:36.901521 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:36.902501 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:36.903038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:36.903626 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:36.948154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:36.956413 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2b84fb9c-c0db-4193-993b-38a3af8dac3b tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.165877 Aug 18 17:11:36.957001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 432/827] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:36 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:36.996491 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b34701f0-f5ab-4a2f-adce-f252f9d19a73 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:36.998736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b34701f0-f5ab-4a2f-adce-f252f9d19a73 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:37.003397 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:37.007045 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b34701f0-f5ab-4a2f-adce-f252f9d19a73 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:37.007577 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b34701f0-f5ab-4a2f-adce-f252f9d19a73 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:37.008017 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b34701f0-f5ab-4a2f-adce-f252f9d19a73 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:37.008725 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b34701f0-f5ab-4a2f-adce-f252f9d19a73 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:37.009182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b34701f0-f5ab-4a2f-adce-f252f9d19a73 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:37.009595 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b34701f0-f5ab-4a2f-adce-f252f9d19a73 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:37.042793 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b34701f0-f5ab-4a2f-adce-f252f9d19a73 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051190 Aug 18 17:11:37.043302 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 433/828] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:11:36 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 18 17:11:37.049482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:37.054156 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:37.054645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:37.057331 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5e867dce-66fd-444d-9090-0a58c1577fd6 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.174738 Aug 18 17:11:37.057909 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 396/829] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:36 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:37.060683 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:37.061163 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:37.061594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:37.062283 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:37.062730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:37.063149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:37.139932 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] HTTP exception thrown: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc is not attached to volume 3fb38cdc-7668-445d-b3bb-272e214bda0d Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Request method failure captured: Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments/3fb38cdc-7668-445d-b3bb-272e214bda0d HTTP/1.1 Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nIO2jmeS9qTBJxYiSBRFTxEHu4JVIKbVYFmz-9c8TdXB1eDSScCVNhI7XCe6SpUaeM248boJQBc50Y_wTSAGmq7ue7l7_0fPeWuNvWvpFZjjCN0TQfE2aqjyj0v8SNM_YTyiPyA5IJSqBO0mYLXDlJSMot8XQ7LSbIrFufZGbpjl5Q Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: af8df1d9e9b54347aa9f29ead57f2797 Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-TestMinimumBasicScenario-534730254 Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:11:37.151690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af8df1d9e9b54347aa9f29ead57f2797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af8df1d9e9b54347aa9f29ead57f2797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/af8df1d9e9b54347aa9f29ead57f2797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_af8df1d9e9b54347aa9f29ead57f2797", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-TestMinimumBasicScenario-534730254 Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: af8df1d9e9b54347aa9f29ead57f2797 Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-TestMinimumBasicScenario-534730254 Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-TestMinimumBasicScenario-534730254-project Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: d981917c507b4d0e876c50ca35f42cea Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-TestMinimumBasicScenario-534730254-project Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:11:37.154253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc is not attached to volume 3fb38cdc-7668-445d-b3bb-272e214bda0d Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'server_id': '34c79a7d-abff-4d4f-aecc-309441c5e3bc', 'id': '3fb38cdc-7668-445d-b3bb-272e214bda0d'} Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 3fb38cdc-7668-445d-b3bb-272e214bda0d. Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:11:37.155736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc is not attached to volume 3fb38cdc-7668-445d-b3bb-272e214bda0d Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc is not attached to volume 3fb38cdc-7668-445d-b3bb-272e214bda0d Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:11:37.157520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Returning 404 to user: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc is not attached to volume 3fb38cdc-7668-445d-b3bb-272e214bda0d {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:11:37.158739 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-132a3943-b243-46b9-b850-fe25e5103788 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments/3fb38cdc-7668-445d-b3bb-272e214bda0d" status: 404 len: 154 microversion: 2.1 time: 0.104482 Aug 18 17:11:37.158739 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 434/830] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:11:37 2022] DELETE /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc/os-volume_attachments/3fb38cdc-7668-445d-b3bb-272e214bda0d => generated 154 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:11:37.451569 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:37.452288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:37.458354 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:37.458847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:37.459291 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:37.462196 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:37.462196 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:37.462196 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:37.598185 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:37.606520 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8ee06fac-60c4-40f5-b110-0b3d1db254e1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.158730 Aug 18 17:11:37.607100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 397/831] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:37 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:37.977235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:37.977903 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:37.984706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:37.985188 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:37.985611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:37.986414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:37.986755 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:37.988948 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.050779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-7739bea2-986a-455d-91d0-be1004b1c998 req-1c99a9ea-6b80-489f-865f-7daeaa20ece2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe34c884-f87c-410a-a740-30046200620f", "name": "network-vif-plugged", "status": "completed", "tag": "163f8304-d484-49c9-8968-b436b23114d7"}, {"server_uuid": "08626bd0-6047-4258-a83d-efb24d789f0d", "name": "network-vif-plugged", "status": "completed", "tag": "73b593a6-2fae-4e85-9374-fafccac8c7ac"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:38.065205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-7739bea2-986a-455d-91d0-be1004b1c998 req-1c99a9ea-6b80-489f-865f-7daeaa20ece2 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.065687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-7739bea2-986a-455d-91d0-be1004b1c998 req-1c99a9ea-6b80-489f-865f-7daeaa20ece2 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.066304 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-7739bea2-986a-455d-91d0-be1004b1c998 req-1c99a9ea-6b80-489f-865f-7daeaa20ece2 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.082660 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-7739bea2-986a-455d-91d0-be1004b1c998 req-1c99a9ea-6b80-489f-865f-7daeaa20ece2 service nova] Creating event network-vif-plugged:163f8304-d484-49c9-8968-b436b23114d7 for instance fe34c884-f87c-410a-a740-30046200620f on hv-cinder-85367 Aug 18 17:11:38.083501 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-7739bea2-986a-455d-91d0-be1004b1c998 req-1c99a9ea-6b80-489f-865f-7daeaa20ece2 service nova] Creating event network-vif-plugged:73b593a6-2fae-4e85-9374-fafccac8c7ac for instance 08626bd0-6047-4258-a83d-efb24d789f0d on hv-cinder-85367 Aug 18 17:11:38.090125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-7739bea2-986a-455d-91d0-be1004b1c998 req-1c99a9ea-6b80-489f-865f-7daeaa20ece2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.043868 Aug 18 17:11:38.090840 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 398/832] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:38.098015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:38.098810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:38.105156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.105733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.106245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.106953 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.107419 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.107877 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.128299 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:38.147954 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-93eb6a40-f5ab-4f7e-9982-b13ca35b5f94 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1573 microversion: 2.1 time: 0.174880 Aug 18 17:11:38.148595 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 435/833] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:37 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1573 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:38.248830 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:38.257274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1448b10b-1df5-4680-bfd7-cbc88e26e172 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.165002 Aug 18 17:11:38.257858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 399/834] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:38 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:38.453934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:38.454592 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:38.461363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.461788 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.462220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.462915 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.463367 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.463838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.489573 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:11:38.507390 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6ba1a977-e4ef-43a4-b1b0-daeace0cd7f4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:38.507956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6ba1a977-e4ef-43a4-b1b0-daeace0cd7f4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:38.514565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ba1a977-e4ef-43a4-b1b0-daeace0cd7f4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.515124 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ba1a977-e4ef-43a4-b1b0-daeace0cd7f4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.515914 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ba1a977-e4ef-43a4-b1b0-daeace0cd7f4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.516700 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ba1a977-e4ef-43a4-b1b0-daeace0cd7f4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.517155 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ba1a977-e4ef-43a4-b1b0-daeace0cd7f4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.517635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6ba1a977-e4ef-43a4-b1b0-daeace0cd7f4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.541475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6ba1a977-e4ef-43a4-b1b0-daeace0cd7f4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/ips" status: 200 len: 152 microversion: 2.20 time: 0.038825 Aug 18 17:11:38.542062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 400/835] 10.222.0.78 () {60 vars in 1289 bytes} [Thu Aug 18 17:11:38 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 18 17:11:38.631350 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:38.632565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:38.642272 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.643365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.644034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.645273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.646494 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.646955 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.788144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:38.795867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c1613cbd-66aa-4393-8599-d1333ce70294 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.170517 Aug 18 17:11:38.796431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 401/836] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:38 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:38.830143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9bb741fe-8480-467a-b693-7bc71d642888 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "DELETE /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 204 len: 0 microversion: 2.1 time: 0.379792 Aug 18 17:11:38.830750 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 436/837] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:11:38 2022] DELETE /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:11:38.844313 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:38.844922 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:38.850810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.851286 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.851748 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.852427 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:38.852877 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:38.853289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:38.982187 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:38.990634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8e2c719a-0052-4e5b-9a7a-555df65a9709 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1555 microversion: 2.1 time: 0.150088 Aug 18 17:11:38.991229 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 402/838] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:38 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:39.169577 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:39.170281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:39.177766 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:39.178448 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:39.178872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:39.179635 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:39.180082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:39.180650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:39.282259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:39.284105 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:39.290949 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:39.297246 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:39.297246 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:39.297246 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:39.297246 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:39.297671 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:39.331975 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:39.341938 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ee7844e3-33dd-4ff9-a0ac-22f48fa4c24c tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1560 microversion: 2.1 time: 0.176792 Aug 18 17:11:39.343132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 437/839] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:39 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1560 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:39.441211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:39.450031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ee0898cc-1bd5-4897-9853-43cfe869cca1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.171657 Aug 18 17:11:39.450819 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 403/840] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:39 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:39.817559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:39.818173 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:39.824231 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:39.824715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:39.825154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:39.825844 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:39.826303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:39.826731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:39.959355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:39.967195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-00910c23-edda-4a6a-aada-91f48a36fadd tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.154068 Aug 18 17:11:39.967813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 438/841] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:39 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:40.010744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:40.011371 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:40.017553 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:40.018049 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:40.018526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:40.019223 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:40.019714 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:40.020143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:40.152649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:40.161184 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e4cdc410-56d8-422c-8766-dbc574c5e2d5 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1555 microversion: 2.1 time: 0.154303 Aug 18 17:11:40.161840 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 404/842] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:40 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:40.472762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:40.473555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:40.480409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:40.480919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:40.481353 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:40.482055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:40.482541 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:40.482967 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:40.772131 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:40.783031 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2e1d0704-0ea9-4cce-80c1-eecd81e1e893 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1366 microversion: 2.1 time: 0.314539 Aug 18 17:11:40.784266 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 439/843] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:40 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1366 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:40.987190 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:40.987765 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:40.994535 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:40.995030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:40.995493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:40.999090 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:40.999090 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:40.999090 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.135849 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:41.144393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e6fb8741-1adf-4ea6-adeb-56d996850d50 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.160565 Aug 18 17:11:41.144964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 405/844] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:40 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:41.182213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:41.182870 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:41.189097 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.189577 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.190014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.191246 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.191738 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.192166 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.202685 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:41.203227 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:41.209820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.210309 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.210744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.211465 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.211929 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.212351 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.234964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lazy-loading 'flavor' on Instance uuid 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:11:41.324510 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:41.332742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-418f48a3-3f84-49b3-ab02-7f0e25f4f563 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1555 microversion: 2.1 time: 0.154468 Aug 18 17:11:41.333312 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 440/845] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:41 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:41.801544 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-85106947-893d-483c-a511-0f606c9b8550 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/action" status: 202 len: 0 microversion: 2.20 time: 0.602565 Aug 18 17:11:41.802070 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 406/846] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Aug 18 17:11:41 2022] POST /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 18 17:11:41.807740 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:41.808487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:41.810638 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:41.812476 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:41.816440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.816934 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.817358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.818055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.818502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.818923 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.819029 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.819526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.820727 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.821506 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.822000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.822433 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:41.958926 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:41.961789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:41.967090 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c5a1f43a-0860-4475-9a7a-b13d87220cc1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1556 microversion: 2.1 time: 0.166224 Aug 18 17:11:41.967937 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 441/847] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:41 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1556 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:41.971239 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:41.973475 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:41.974857 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c76c3f45-a5bb-477c-bae6-b0757538f15d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.168559 Aug 18 17:11:41.975401 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 407/848] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:41 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:11:41.991668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c0871804-31d2-4846-9370-d808648be66b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:41.992171 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c0871804-31d2-4846-9370-d808648be66b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:41.998322 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0871804-31d2-4846-9370-d808648be66b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:41.998894 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0871804-31d2-4846-9370-d808648be66b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:41.999574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0871804-31d2-4846-9370-d808648be66b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:42.000284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0871804-31d2-4846-9370-d808648be66b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:42.000742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0871804-31d2-4846-9370-d808648be66b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:42.001175 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0871804-31d2-4846-9370-d808648be66b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:42.085559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c0871804-31d2-4846-9370-d808648be66b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098441 Aug 18 17:11:42.086150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 442/849] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Aug 18 17:11:41 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:42.167779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:42.169096 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:42.178089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:42.178581 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:42.179017 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:42.179769 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:42.180226 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:42.180649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:42.354149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:42.354801 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:42.361665 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:42.362225 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:42.362722 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:42.363481 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:42.364089 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:42.364542 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:42.367778 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:42.391569 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-05e47ae2-b84e-43ea-b79a-eef234597ba5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1363 microversion: 2.1 time: 0.228715 Aug 18 17:11:42.392493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 408/850] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:42 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:42.647758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:42.656316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9dbd132a-0fd5-4f41-8572-9f34bfe985cb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1555 microversion: 2.1 time: 0.306181 Aug 18 17:11:42.657084 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 443/851] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:42 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1555 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:11:43.006334 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:43.006959 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:43.015340 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:43.016260 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:43.016993 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:43.017755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:43.018221 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:43.018821 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:43.038978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:43.161593 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:43.171830 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:43.173359 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:43.175224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5a52580e-a80f-445e-b383-3f204fb6d8b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.172838 Aug 18 17:11:43.175871 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 409/852] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:43 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:43.413818 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:43.414447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:43.420637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:43.421134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:43.421570 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:43.422282 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:43.422740 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:43.423163 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:43.605876 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-62ef65ca-46d7-40fb-a74e-208eb703b712 req-1c26a3ce-9796-4f69-a6ab-36d23bc673a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34c79a7d-abff-4d4f-aecc-309441c5e3bc", "name": "network-vif-deleted", "tag": "2ee00035-edc8-4a51-89b1-4dc0e2c5a468"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:43.626859 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-62ef65ca-46d7-40fb-a74e-208eb703b712 req-1c26a3ce-9796-4f69-a6ab-36d23bc673a8 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:43.627348 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-62ef65ca-46d7-40fb-a74e-208eb703b712 req-1c26a3ce-9796-4f69-a6ab-36d23bc673a8 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:43.632575 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-62ef65ca-46d7-40fb-a74e-208eb703b712 req-1c26a3ce-9796-4f69-a6ab-36d23bc673a8 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:43.653385 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-62ef65ca-46d7-40fb-a74e-208eb703b712 req-1c26a3ce-9796-4f69-a6ab-36d23bc673a8 service nova] Creating event network-vif-deleted:2ee00035-edc8-4a51-89b1-4dc0e2c5a468 for instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc on hv-cinder-85367 Aug 18 17:11:43.667873 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-62ef65ca-46d7-40fb-a74e-208eb703b712 req-1c26a3ce-9796-4f69-a6ab-36d23bc673a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061291 Aug 18 17:11:43.669829 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 410/853] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:43.683175 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:43.683175 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:43.688844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:43.689398 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:43.689841 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:43.690694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:43.691315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:43.691810 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:43.699773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:43.724822 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e62ae062-b803-44c4-831c-f9bd8add6f03 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1548 microversion: 2.1 time: 0.315116 Aug 18 17:11:43.726009 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 444/854] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:43 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1548 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:43.746375 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8d7c51d8-8980-4333-8555-0cbfcd81cfee tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:43.746961 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8d7c51d8-8980-4333-8555-0cbfcd81cfee tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:43.753081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d7c51d8-8980-4333-8555-0cbfcd81cfee tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:43.753691 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d7c51d8-8980-4333-8555-0cbfcd81cfee tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:43.754192 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d7c51d8-8980-4333-8555-0cbfcd81cfee tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:43.755151 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d7c51d8-8980-4333-8555-0cbfcd81cfee tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:43.755893 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d7c51d8-8980-4333-8555-0cbfcd81cfee tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:43.756466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d7c51d8-8980-4333-8555-0cbfcd81cfee tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:43.785587 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:43.794833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-aab45048-c64a-42c8-9179-cb17eb3a7441 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1513 microversion: 2.1 time: 0.120761 Aug 18 17:11:43.795411 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 411/855] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:43 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1513 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:43.841795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8d7c51d8-8980-4333-8555-0cbfcd81cfee tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099335 Aug 18 17:11:43.842391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 445/856] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Aug 18 17:11:43 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:11:44.203597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:44.204933 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:44.212426 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:44.213158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:44.213589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:44.214531 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:44.214980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:44.215598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:44.433690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:44.444614 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:44.446521 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:44.448042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8c0bd021-a47f-4a57-9106-b4d75f8a4f63 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.248748 Aug 18 17:11:44.465029 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 412/857] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:44 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:44.816909 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:44.818230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:44.824258 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:44.824741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:44.825251 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:44.826033 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:44.826490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:44.826907 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:44.858891 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:44.859758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:44.860340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:44.861023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lazy-loading 'fault' on Instance uuid 34c79a7d-abff-4d4f-aecc-309441c5e3bc {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:11:44.916160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd981917c507b4d0e876c50ca35f42cea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af8df1d9e9b54347aa9f29ead57f2797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:44.922844 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:11:44.929252 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-91eb4d9f-a0b8-4370-85c0-abcd9ef8dbfb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 200 len: 1349 microversion: 2.1 time: 0.117202 Aug 18 17:11:44.930294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 446/858] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:44 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 1349 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:11:45.472402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:45.473097 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:45.480250 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:45.480739 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:45.481231 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:45.481857 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:45.482312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:45.482736 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:45.524516 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-3cc92db1-30a0-4130-9e1b-809bc6df3e55 req-0c9c1813-54fa-47b5-bd53-d8928d597717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08626bd0-6047-4258-a83d-efb24d789f0d", "tag": "73b593a6-2fae-4e85-9374-fafccac8c7ac"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:45.535912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-3cc92db1-30a0-4130-9e1b-809bc6df3e55 req-0c9c1813-54fa-47b5-bd53-d8928d597717 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:45.536762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-3cc92db1-30a0-4130-9e1b-809bc6df3e55 req-0c9c1813-54fa-47b5-bd53-d8928d597717 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:45.537478 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-3cc92db1-30a0-4130-9e1b-809bc6df3e55 req-0c9c1813-54fa-47b5-bd53-d8928d597717 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:45.551969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-3cc92db1-30a0-4130-9e1b-809bc6df3e55 req-0c9c1813-54fa-47b5-bd53-d8928d597717 service nova] Creating event network-changed:73b593a6-2fae-4e85-9374-fafccac8c7ac for instance 08626bd0-6047-4258-a83d-efb24d789f0d on hv-cinder-85367 Aug 18 17:11:45.557804 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-3cc92db1-30a0-4130-9e1b-809bc6df3e55 req-0c9c1813-54fa-47b5-bd53-d8928d597717 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037143 Aug 18 17:11:45.558733 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 447/859] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:45.676556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:45.685601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:45.687416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:45.688383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-0336f17a-d54b-4c54-a60c-3026acf97a82 req-ce0762f6-8006-47e5-8945-14866967fca7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe34c884-f87c-410a-a740-30046200620f", "tag": "163f8304-d484-49c9-8968-b436b23114d7"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:11:45.688844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9944b75a-ab30-481f-bea3-ffbe7b1649b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.221071 Aug 18 17:11:45.689505 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 413/860] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:45 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:45.699759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-0336f17a-d54b-4c54-a60c-3026acf97a82 req-ce0762f6-8006-47e5-8945-14866967fca7 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:45.703666 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-0336f17a-d54b-4c54-a60c-3026acf97a82 req-ce0762f6-8006-47e5-8945-14866967fca7 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:45.704521 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-0336f17a-d54b-4c54-a60c-3026acf97a82 req-ce0762f6-8006-47e5-8945-14866967fca7 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:45.717757 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-0336f17a-d54b-4c54-a60c-3026acf97a82 req-ce0762f6-8006-47e5-8945-14866967fca7 service nova] Creating event network-changed:163f8304-d484-49c9-8968-b436b23114d7 for instance fe34c884-f87c-410a-a740-30046200620f on hv-cinder-85367 Aug 18 17:11:45.723132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-0336f17a-d54b-4c54-a60c-3026acf97a82 req-ce0762f6-8006-47e5-8945-14866967fca7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038608 Aug 18 17:11:45.723909 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 448/861] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:11:45.955590 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:45.957027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] [instance: 34c79a7d-abff-4d4f-aecc-309441c5e3bc] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:45.973553 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:45.974880 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:45.976973 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:45.977848 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:45.981035 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:45.983547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:46.019961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] HTTP exception thrown: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc could not be found. Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Request method failure captured: Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc HTTP/1.1 Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nIO2jmeS9qTBJxYiSBRFTxEHu4JVIKbVYFmz-9c8TdXB1eDSScCVNhI7XCe6SpUaeM248boJQBc50Y_wTSAGmq7ue7l7_0fPeWuNvWvpFZjjCN0TQfE2aqjyj0v8SNM_YTyiPyA5IJSqBO0mYLXDlJSMot8XQ7LSbIrFufZGbpjl5Q Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: af8df1d9e9b54347aa9f29ead57f2797 Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-TestMinimumBasicScenario-534730254 Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:11:46.022280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af8df1d9e9b54347aa9f29ead57f2797"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/af8df1d9e9b54347aa9f29ead57f2797"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/af8df1d9e9b54347aa9f29ead57f2797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_af8df1d9e9b54347aa9f29ead57f2797", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-TestMinimumBasicScenario-534730254 Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: af8df1d9e9b54347aa9f29ead57f2797 Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-TestMinimumBasicScenario-534730254 Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-TestMinimumBasicScenario-534730254-project Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: d981917c507b4d0e876c50ca35f42cea Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-TestMinimumBasicScenario-534730254-project Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc could not be found. Aug 18 17:11:46.024100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '34c79a7d-abff-4d4f-aecc-309441c5e3bc'} Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc could not be found. Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:11:46.025052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc could not be found. Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc could not be found. Aug 18 17:11:46.026667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:11:46.029807 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Returning 404 to user: Instance 34c79a7d-abff-4d4f-aecc-309441c5e3bc could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:11:46.030935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-45b7ed01-544f-4179-9650-911feb176659 tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc" status: 404 len: 111 microversion: 2.1 time: 0.080652 Aug 18 17:11:46.032111 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 414/862] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:11:45 2022] GET /compute/v2.1/servers/34c79a7d-abff-4d4f-aecc-309441c5e3bc => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:11:46.043055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2de63159-f5ef-4f06-9599-3c1d4db48feb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] Calling method '.version_select at 0x7ff5b4c2c160>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:46.130041 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2de63159-f5ef-4f06-9599-3c1d4db48feb tempest-TestMinimumBasicScenario-534730254 tempest-TestMinimumBasicScenario-534730254-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1699644400" status: 202 len: 0 microversion: 2.1 time: 0.092760 Aug 18 17:11:46.140734 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 449/863] 10.222.0.78 () {58 vars in 1272 bytes} [Thu Aug 18 17:11:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1699644400 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:11:46.713244 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:46.714031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:46.722515 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:46.723275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:46.723923 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:46.724776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:46.725558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:46.726035 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:46.881726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:46.892435 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:46.894487 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:46.895690 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f2dd004b-649c-41b6-9150-d704d4ed7eb3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.187058 Aug 18 17:11:46.902927 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 415/864] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:46 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:47.919500 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:47.920356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:47.928160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:47.928652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:47.929099 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:47.929833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:47.930278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:47.930818 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:48.085191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:48.093645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:48.095211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:48.096530 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b43e5f9a-2b85-4e60-9544-c5dd5a0e9ae2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.181604 Aug 18 17:11:48.097078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 450/865] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:47 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:49.119837 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:49.120461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:49.129433 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:49.129942 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:49.130387 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:49.131212 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:49.131732 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:49.132211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:49.571944 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:49.580480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:49.582080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:49.583256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-408b1768-ec55-4354-9683-07840db512d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.467595 Aug 18 17:11:49.583886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 416/866] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:49 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:50.614007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:50.614007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:50.614007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:50.614761 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:50.614855 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:50.615593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:50.616094 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:50.616524 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:50.918223 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:50.926423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:50.927953 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:50.929118 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f22ccf72-6cd2-4a61-ad33-85bfe10b7f87 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.326843 Aug 18 17:11:50.929675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 451/867] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:50 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:51.953331 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:51.954744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:51.965075 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:51.978404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:51.978872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:51.979692 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:51.980164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:51.980604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:52.127428 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:52.133467 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:52.134987 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:52.136196 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-90f86898-8961-4f61-804d-4ff1a1e1d94b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.187533 Aug 18 17:11:52.136762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 417/868] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:51 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:53.160593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:53.161783 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:53.170445 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:53.171251 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:53.171914 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:53.172639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:53.173107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:53.173537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:53.398975 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:53.407258 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:53.408974 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:53.410670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e538b153-03ec-4a16-812b-e90bdf7dfa74 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.254949 Aug 18 17:11:53.411234 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 452/869] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:53 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:54.434003 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:54.434551 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:54.441802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:54.442332 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:54.442770 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:54.443494 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:54.444068 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:54.444498 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:54.581595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:54.590979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:54.592572 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:54.593779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-33bc0500-8023-4dd1-bac0-7e85f0d23a5b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.163877 Aug 18 17:11:54.594881 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 418/870] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:54 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:55.619962 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:55.623994 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:55.632004 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:55.632497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:55.632933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:55.633998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:55.634458 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:55.634885 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:55.796245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:55.806694 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:55.808412 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:55.809618 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1d59d45f-4ecb-4751-b567-807137a9ffa2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.196122 Aug 18 17:11:55.810583 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 453/871] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:55 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:56.834351 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:56.835024 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:56.841780 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:56.842267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:56.842757 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:56.843611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:56.844110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:56.844582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:56.980960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:56.990118 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:56.991660 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:56.993002 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-540833d9-97f7-45e7-ac4f-8d4d3224d0f2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.163282 Aug 18 17:11:56.993569 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 419/872] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:56 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:58.016270 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:58.016899 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:58.025251 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:58.025743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:58.027118 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:58.028006 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:58.028488 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:58.028930 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:58.164365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:58.172622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:58.174114 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:58.175264 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-fcda5f18-02f3-4951-87a9-706b4aa94343 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.163476 Aug 18 17:11:58.175861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 454/873] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:58 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:11:59.198840 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:11:59.199516 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:11:59.206169 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:59.206761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:59.207168 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:59.207910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:11:59.208370 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:11:59.209243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:11:59.427206 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:59.436940 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:59.438561 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:11:59.442735 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-22c39c57-b6de-47ac-886b-a6350ef1aca4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.244841 Aug 18 17:11:59.442735 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 420/874] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:11:59 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:00.462195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:00.462805 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:00.469002 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:00.469493 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:00.469935 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:00.470637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:00.471100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:00.471566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:00.709023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:00.718891 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:00.720670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:00.721853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-592ef7a6-8967-4125-b317-439340c887ac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.263506 Aug 18 17:12:00.722408 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 455/875] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:00 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:12:01.746138 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:01.746759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:01.755711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:01.756522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:01.756970 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:01.757721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:01.758351 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:01.758994 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:01.919834 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:01.929620 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:01.931356 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:01.932565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f4c350ef-eb19-44c7-bd20-7f88d24ea560 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.190689 Aug 18 17:12:01.934006 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 421/876] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:01 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:02.957279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:02.957923 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:02.966458 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:02.966958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:02.967391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:02.968126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:02.968577 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:02.969462 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:03.170361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:03.181680 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:03.184291 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:03.185535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f9eb04cd-db1a-4112-9f8c-b2559f3b3297 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.233109 Aug 18 17:12:03.186107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 456/877] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:02 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:04.209559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:04.213687 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:04.231986 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=74 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:04.233710 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:04.234559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:04.234868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:04.235608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:04.236115 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:04.236715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:04.389248 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:04.398391 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:04.400026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:04.401221 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c25e2969-0626-4dfd-940a-f21f88a7b894 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1744 microversion: 2.20 time: 0.196103 Aug 18 17:12:04.401790 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 422/878] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:04 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1744 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:05.426831 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:05.427710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:05.434806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:05.435301 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:05.435766 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:05.437078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:05.437702 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:05.438279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:05.604456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:05.620866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:05.622564 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:05.624329 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-92d376d0-9e4d-41ef-a098-a5e61604eef6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1744 microversion: 2.20 time: 0.201956 Aug 18 17:12:05.625373 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 457/879] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:05 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:06.649596 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:06.650833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:06.661077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:06.661951 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:06.663081 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:06.664125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:06.664957 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:06.665556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:06.872544 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-3345196b-1dac-49e9-9b48-9f5751f4deab req-8886254a-b437-4ac2-a31b-ddf116bc92a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5400d9b3-34f6-451c-bb5c-ae2b231dcc5b", "name": "network-vif-plugged", "status": "completed", "tag": "6a4d4f56-49e2-4fd7-905b-4ed206d8d756"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:06.885125 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-3345196b-1dac-49e9-9b48-9f5751f4deab req-8886254a-b437-4ac2-a31b-ddf116bc92a8 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:06.885826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-3345196b-1dac-49e9-9b48-9f5751f4deab req-8886254a-b437-4ac2-a31b-ddf116bc92a8 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:06.886433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-3345196b-1dac-49e9-9b48-9f5751f4deab req-8886254a-b437-4ac2-a31b-ddf116bc92a8 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:06.900899 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-3345196b-1dac-49e9-9b48-9f5751f4deab req-8886254a-b437-4ac2-a31b-ddf116bc92a8 service nova] Creating event network-vif-plugged:6a4d4f56-49e2-4fd7-905b-4ed206d8d756 for instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b on hv-cinder-85367 Aug 18 17:12:06.912328 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-3345196b-1dac-49e9-9b48-9f5751f4deab req-8886254a-b437-4ac2-a31b-ddf116bc92a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043521 Aug 18 17:12:06.913403 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 458/880] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:12:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:07.385035 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:07.394197 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:07.395800 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:07.397016 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-14132db5-4194-4d2b-b54e-6c69f43816d6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1744 microversion: 2.20 time: 0.752491 Aug 18 17:12:07.397582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 423/881] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:06 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1744 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:08.426515 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:08.427211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:08.429437 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:08.434936 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:08.435697 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:08.436335 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:08.437226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:08.437848 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:08.438578 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:08.776628 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:08.792759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:08.792759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:08.793685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7c12fd14-d597-4d78-8e4c-81396bd6c234 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.370672 Aug 18 17:12:08.803196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 459/882] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:08 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:09.824398 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:09.825686 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:09.836019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:09.842288 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:09.843391 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:09.844374 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:09.845004 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:09.845434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:10.061368 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:10.078188 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:10.079761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:10.080975 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7928aaf9-f62f-478a-bdf2-5d719e282573 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.261457 Aug 18 17:12:10.083275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 424/883] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:09 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:11.105773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:11.109983 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:11.125237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:11.126000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:11.126677 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:11.128480 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:11.129157 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:11.129769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:11.366968 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:11.380144 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:11.397762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:11.399785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d4ec715e-ab9b-4240-aa84-7c8be3e251ef tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.298637 Aug 18 17:12:11.415471 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 460/884] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:11 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:11.909086 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-967f2ecc-1e4b-43d1-868b-0047655abcaa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Action: 'create', calling method: .version_select at 0x7ff5b4c5ce50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-513148516", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBgPO5GQMD5byFI3yDI0FZXP5CHLX3iHkItsAnK/Zn7t3xj0kdcwR7ZWW/u6cDENrNH11/I6wvTl5UqyGQm3i8J5z2dboNz90hlvlthtVBzgkpLEuUgXOpz3/x+OBoLm/w=="}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:11.939218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-967f2ecc-1e4b-43d1-868b-0047655abcaa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Getting quotas for project c5e8eba08dfc4946becd6dba63f94eec. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:12:11.946528 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-967f2ecc-1e4b-43d1-868b-0047655abcaa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Getting quotas for user f9d0f858ee07466a90d9c1ecf2c18c19 and project c5e8eba08dfc4946becd6dba63f94eec. Resources: {'key_pairs'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:12:12.102017 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-967f2ecc-1e4b-43d1-868b-0047655abcaa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.447398 Aug 18 17:12:12.104854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 425/885] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:12:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:12.430578 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:12.431213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:12.438339 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:12.438830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:12.439267 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:12.440019 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:12.440504 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:12.440912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:12.592264 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:12.604693 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:12.606205 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:12.607378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c3aef932-dbc6-4a5e-aaa5-b7a8ba9a315f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.180857 Aug 18 17:12:12.607973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 461/886] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:12 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:13.631203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:13.631912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:13.639371 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:13.644915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:13.645707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:13.647115 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:13.648190 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:13.649091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:13.861691 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:13.870694 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:13.873023 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:13.874510 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4d744e19-fd9b-4003-b806-671876cecb89 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.247879 Aug 18 17:12:13.875072 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 426/887] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:13 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:14.900343 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:14.900989 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:14.911548 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:14.912303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:14.912858 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:14.913863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:14.914429 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:14.915025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:15.120415 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:15.150061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:15.152833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:15.161921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ab9671ef-96b7-4cb1-87c6-11cf6c53e70d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.257976 Aug 18 17:12:15.162773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 462/888] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:14 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:16.186560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:16.187194 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:16.195266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:16.195786 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:16.196225 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:16.196974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:16.197428 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:16.197881 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:16.204515 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=91 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:16.346434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:16.355327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:16.357637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:16.359105 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-80a7bbbd-e433-4312-aa2e-f2d4f8e307c0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.176502 Aug 18 17:12:16.359462 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 427/889] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:16 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:17.383369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:17.384028 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:17.394917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:17.397684 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:17.398734 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:17.398928 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:17.399397 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:17.399866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:17.585087 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:17.592633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:17.594559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:17.596711 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-99287665-2d7a-40c0-9a07-d62cb75d4ed2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.217147 Aug 18 17:12:17.598280 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 463/890] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:17 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:18.626953 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:18.628273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:18.638931 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:18.640146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:18.640604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:18.641485 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:18.641964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:18.642390 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:18.837254 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:18.858847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:18.858847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:18.858847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-654a8819-19be-4721-bace-eb0a1801fa2f tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.229368 Aug 18 17:12:18.859212 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 428/891] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:18 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:19.875704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:19.876321 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:19.882865 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:19.883362 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:19.883837 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:19.884549 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:19.885008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:19.885464 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:19.888476 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=85 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:20.051216 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:20.059206 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:20.060842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:20.065283 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-499dc323-036a-44e1-8858-afca6382e84a tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.190205 Aug 18 17:12:20.065283 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 464/892] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:19 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:21.089808 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:21.092283 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:21.097161 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:21.097658 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:21.098131 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:21.098826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:21.099284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:21.099732 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:21.237509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:21.245824 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:21.247393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:21.250153 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-082515f0-f72f-41f6-9fdb-14510b859119 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1739 microversion: 2.20 time: 0.167993 Aug 18 17:12:21.250899 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 429/893] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:21 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:22.274205 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:22.276165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:22.283728 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:22.284226 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:22.284667 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:22.285380 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:22.286477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:22.286947 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:22.432530 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:22.441096 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:22.443135 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:22.444754 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-56532249-6921-4c62-9512-a432cb15abf3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1721 microversion: 2.20 time: 0.175167 Aug 18 17:12:22.445654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 465/894] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:22 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:23.468924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:23.469542 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:23.471400 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=4 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:23.476758 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:23.477243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:23.477711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:23.478409 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:23.478866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:23.479287 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:23.621980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:23.630767 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:23.632311 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:23.633477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-45da19d9-8058-4615-9636-9ebf6aaf12d8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1721 microversion: 2.20 time: 0.168528 Aug 18 17:12:23.634032 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 430/895] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:23 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:24.658192 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:24.658805 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:24.667362 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:24.667675 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:24.668150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:24.668867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:24.669326 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:24.669802 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:24.806810 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:24.815700 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:24.817204 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:24.818410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-22827576-ec78-4921-bdc1-ce3b39ce2d39 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1721 microversion: 2.20 time: 0.164144 Aug 18 17:12:24.818948 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 466/896] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:24 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:25.840959 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:25.841506 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:25.847897 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:25.848373 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:25.848804 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:25.849487 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:25.849937 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:25.850355 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:25.980858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:25.991196 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:25.992911 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:25.994094 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1434becc-19fe-411b-8973-e43e443a2572 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1664 microversion: 2.20 time: 0.157089 Aug 18 17:12:25.994680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 431/897] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:25 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:26.017011 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ddbac03e-a414-4de6-93d5-d409ffc82720 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d831ac7-9748-48fa-9548-7c426066143d"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:26.019339 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ddbac03e-a414-4de6-93d5-d409ffc82720 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:26.025931 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ddbac03e-a414-4de6-93d5-d409ffc82720 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:26.026401 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ddbac03e-a414-4de6-93d5-d409ffc82720 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:26.026843 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ddbac03e-a414-4de6-93d5-d409ffc82720 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:26.027578 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ddbac03e-a414-4de6-93d5-d409ffc82720 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:26.028039 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ddbac03e-a414-4de6-93d5-d409ffc82720 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:26.028465 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ddbac03e-a414-4de6-93d5-d409ffc82720 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:26.682224 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-309becd4-d6c4-416d-aa49-8d96750e512b req-97fffab4-3d76-44eb-8034-8c07f8450880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5400d9b3-34f6-451c-bb5c-ae2b231dcc5b", "name": "network-vif-unplugged", "status": "completed", "tag": "6a4d4f56-49e2-4fd7-905b-4ed206d8d756"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:26.691597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-309becd4-d6c4-416d-aa49-8d96750e512b req-97fffab4-3d76-44eb-8034-8c07f8450880 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:26.692089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-309becd4-d6c4-416d-aa49-8d96750e512b req-97fffab4-3d76-44eb-8034-8c07f8450880 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:26.692514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-309becd4-d6c4-416d-aa49-8d96750e512b req-97fffab4-3d76-44eb-8034-8c07f8450880 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:26.715283 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.compute.server_external_events [req-309becd4-d6c4-416d-aa49-8d96750e512b req-97fffab4-3d76-44eb-8034-8c07f8450880 service nova] Unable to find a host for instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b. Dropping event network-vif-unplugged {{(pid=121268) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 18 17:12:26.715283 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-309becd4-d6c4-416d-aa49-8d96750e512b req-97fffab4-3d76-44eb-8034-8c07f8450880 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.036181 Aug 18 17:12:26.715283 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 432/898] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:12:26 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 37 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 18 17:12:27.033679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ddbac03e-a414-4de6-93d5-d409ffc82720 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.020513 Aug 18 17:12:27.034340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 467/899] 10.222.0.78 () {62 vars in 1364 bytes} [Thu Aug 18 17:12:26 2022] POST /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/os-volume_attachments => generated 188 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 18 17:12:27.165336 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-812a5125-e72e-4606-a4ab-e4209ff13ede tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:27.165889 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-812a5125-e72e-4606-a4ab-e4209ff13ede tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:27.172321 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812a5125-e72e-4606-a4ab-e4209ff13ede tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:27.172832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812a5125-e72e-4606-a4ab-e4209ff13ede tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:27.173262 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812a5125-e72e-4606-a4ab-e4209ff13ede tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:27.173956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812a5125-e72e-4606-a4ab-e4209ff13ede tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:27.174410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812a5125-e72e-4606-a4ab-e4209ff13ede tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:27.174834 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-812a5125-e72e-4606-a4ab-e4209ff13ede tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:27.363418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-68c5d76a-2f3d-4497-a842-17d3098986da tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:27.363940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-68c5d76a-2f3d-4497-a842-17d3098986da tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:27.371774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-68c5d76a-2f3d-4497-a842-17d3098986da tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:27.372395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-68c5d76a-2f3d-4497-a842-17d3098986da tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:27.372691 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-68c5d76a-2f3d-4497-a842-17d3098986da tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:27.373414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-68c5d76a-2f3d-4497-a842-17d3098986da tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:27.373874 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-68c5d76a-2f3d-4497-a842-17d3098986da tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:27.374361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-68c5d76a-2f3d-4497-a842-17d3098986da tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:27.402897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-68c5d76a-2f3d-4497-a842-17d3098986da tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/ips" status: 200 len: 150 microversion: 2.1 time: 0.043427 Aug 18 17:12:27.403497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 468/900] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:12:27 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:27.897168 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-812a5125-e72e-4606-a4ab-e4209ff13ede tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/os-volume_attachments/4d831ac7-9748-48fa-9548-7c426066143d" status: 202 len: 0 microversion: 2.20 time: 0.735663 Aug 18 17:12:27.897776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 433/901] 10.222.0.78 () {60 vars in 1457 bytes} [Thu Aug 18 17:12:27 2022] DELETE /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/os-volume_attachments/4d831ac7-9748-48fa-9548-7c426066143d => generated 0 bytes in 737 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:12:27.963857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:27.964459 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:27.970375 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:27.970859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:27.971293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:27.972016 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:27.972470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:27.972892 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:28.012444 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121267) unshelve /opt/stack/nova/nova/compute/api.py:4587}} Aug 18 17:12:28.253108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-21b92088-87d6-4696-af3e-4c0c89ceebac tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "POST /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/action" status: 202 len: 0 microversion: 2.20 time: 0.293139 Aug 18 17:12:28.254064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 469/902] 10.222.0.78 () {62 vars in 1319 bytes} [Thu Aug 18 17:12:27 2022] POST /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/action => generated 0 bytes in 295 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:12:28.262343 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:28.262965 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:28.269486 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:28.269982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:28.270426 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:28.271672 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:28.272130 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:28.274492 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:28.414378 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:28.422707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:28.424256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:28.425441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6616ee64-f7c5-4971-950f-18a335be99a8 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1672 microversion: 2.20 time: 0.167416 Aug 18 17:12:28.426008 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 434/903] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:28 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:29.109337 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bdf07320-35a2-4fbe-910d-6a363b1f4cc3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65ef8a08-5e0a-4b67-a456-7250f24d73c8"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:29.111938 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bdf07320-35a2-4fbe-910d-6a363b1f4cc3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:29.118929 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf07320-35a2-4fbe-910d-6a363b1f4cc3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:29.122220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf07320-35a2-4fbe-910d-6a363b1f4cc3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:29.122220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf07320-35a2-4fbe-910d-6a363b1f4cc3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:29.122220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf07320-35a2-4fbe-910d-6a363b1f4cc3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:29.122220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf07320-35a2-4fbe-910d-6a363b1f4cc3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:29.122600 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bdf07320-35a2-4fbe-910d-6a363b1f4cc3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:29.448523 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:29.449170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:29.455697 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:29.456181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:29.456698 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:29.457466 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:29.457928 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:29.458857 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:29.610410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:29.618695 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:29.620251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:29.621436 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0eac9910-d76a-40ee-b251-543a5b8db84b tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1672 microversion: 2.20 time: 0.176939 Aug 18 17:12:29.621997 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 435/904] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:29 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1672 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:30.022574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bdf07320-35a2-4fbe-910d-6a363b1f4cc3 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "POST /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.917507 Aug 18 17:12:30.023207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 470/905] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:12:29 2022] POST /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 194 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:30.644502 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:30.645122 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:30.651924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:30.652412 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:30.652852 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:30.653580 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:30.654032 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:30.654516 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:30.874102 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:30.882680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:30.884390 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:30.885814 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b17f97d4-c5c0-4ebf-a6dc-3054f0fb6614 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.245215 Aug 18 17:12:30.886654 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 436/906] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:30 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:31.911932 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:31.914458 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:31.924825 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:31.925979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:31.926649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:31.928845 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:31.929789 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:31.930469 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:32.088824 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:32.097603 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:32.099889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:32.101210 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cfdf5477-79e1-4411-8c11-e2f139777d50 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.194541 Aug 18 17:12:32.101864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 471/907] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:31 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:32.823591 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e99a2d8a-d16d-4c77-89b7-148079069417 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:32.824179 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e99a2d8a-d16d-4c77-89b7-148079069417 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:32.831202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e99a2d8a-d16d-4c77-89b7-148079069417 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:32.832165 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e99a2d8a-d16d-4c77-89b7-148079069417 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:32.832538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e99a2d8a-d16d-4c77-89b7-148079069417 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:32.833816 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e99a2d8a-d16d-4c77-89b7-148079069417 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:32.834310 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e99a2d8a-d16d-4c77-89b7-148079069417 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:32.834739 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e99a2d8a-d16d-4c77-89b7-148079069417 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:32.859558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e99a2d8a-d16d-4c77-89b7-148079069417 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/ips" status: 200 len: 145 microversion: 2.1 time: 0.039771 Aug 18 17:12:32.860144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 437/908] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:12:32 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:33.125316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:33.126584 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:33.134359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:33.135106 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:33.135773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:33.136762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:33.137212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:33.137637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:33.282296 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:33.292157 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:33.294153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:33.295741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9f0babc1-8a55-426b-a6ea-b1e64206269d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.174427 Aug 18 17:12:33.296360 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 472/909] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:33 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:12:33.742141 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1445005019", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-513148516", "security_groups": [{"name": "tempest-secgroup-smoke-1612543765"}], "block_device_mapping_v2": [{"uuid": "da67211e-440f-4457-bfe2-92a5b7fa11e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "744636b7-76bc-439f-9116-8e1ee85b3624"}]}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:33.866236 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] validate_networks() for [('744636b7-76bc-439f-9116-8e1ee85b3624', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:12:34.291320 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:12:34.292026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:12:34.292846 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:12:34.293471 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:12:34.294088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:12:34.306374 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:34.307956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:34.308406 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:34.309164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:34.310790 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:34.314667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:34.319159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:34.320439 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:34.328710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:34.329209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:34.329641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:34.330356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:34.330827 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:34.331258 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:34.339747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Getting quotas for project c5e8eba08dfc4946becd6dba63f94eec. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:12:34.347080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Getting quotas for user f9d0f858ee07466a90d9c1ecf2c18c19 and project c5e8eba08dfc4946becd6dba63f94eec. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:12:34.362365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:34.459115 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:12:34.461398 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da67211e-440f-4457-bfe2-92a5b7fa11e3',volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:12:34.540534 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:34.550356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:34.553029 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:34.554711 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e820e6f3-a881-4a02-a411-a1bae94992d9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.240227 Aug 18 17:12:34.555384 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 473/910] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:34 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:34.827747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-827b77ea-8a3a-41ef-b97f-68fafcfcd2dd tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.089107 Aug 18 17:12:34.828715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 438/911] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:12:33 2022] POST /compute/v2.1/servers => generated 406 bytes in 1091 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:12:34.842157 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9d2d37d6-cb66-4907-bf2f-132a59ea6925 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:34.843424 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9d2d37d6-cb66-4907-bf2f-132a59ea6925 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:34.948723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9d2d37d6-cb66-4907-bf2f-132a59ea6925 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:34.957617 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9d2d37d6-cb66-4907-bf2f-132a59ea6925 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1094 microversion: 2.1 time: 0.118778 Aug 18 17:12:34.959066 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 474/912] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:34 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:35.585865 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:35.586555 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:35.594600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:35.595201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:35.595682 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:35.596465 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:35.596931 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:35.597367 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:35.765101 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:35.775454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:35.777584 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:35.778994 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0763ed8b-9c8d-49c6-907e-f7b9c273e973 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.204694 Aug 18 17:12:35.779741 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 439/913] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:35 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:35.979082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f4f5660a-1f24-4074-b71f-3fded5e47f02 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:35.979771 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f4f5660a-1f24-4074-b71f-3fded5e47f02 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:36.038303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f4f5660a-1f24-4074-b71f-3fded5e47f02 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:36.048969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f4f5660a-1f24-4074-b71f-3fded5e47f02 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1094 microversion: 2.1 time: 0.073817 Aug 18 17:12:36.049840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 475/914] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:35 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1094 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:36.607280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6da9d0fe-55ce-4201-b6be-e9ddcaacdaa4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35868587-0ec1-4c16-aa70-f990983de9cc"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:36.610165 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-6da9d0fe-55ce-4201-b6be-e9ddcaacdaa4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:36.616733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6da9d0fe-55ce-4201-b6be-e9ddcaacdaa4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:36.617216 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6da9d0fe-55ce-4201-b6be-e9ddcaacdaa4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:36.617647 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6da9d0fe-55ce-4201-b6be-e9ddcaacdaa4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:36.618384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6da9d0fe-55ce-4201-b6be-e9ddcaacdaa4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:36.618791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6da9d0fe-55ce-4201-b6be-e9ddcaacdaa4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:36.619209 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-6da9d0fe-55ce-4201-b6be-e9ddcaacdaa4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:36.804260 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:36.804881 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:36.811002 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:36.811518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:36.811964 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:36.812669 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:36.813129 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:36.813555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:36.963070 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:36.971556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:36.973128 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:36.974267 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-26690bc3-b23d-4416-a767-36b139cfd1f6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.174052 Aug 18 17:12:36.975044 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 476/915] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:36 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:12:37.070792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:37.072148 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:37.078894 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:37.079382 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:37.079842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:37.080551 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:37.081007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:37.081427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:37.149330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:37.157571 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-203815c3-b4ef-46e7-946d-60ba52e4b35e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1144 microversion: 2.1 time: 0.091217 Aug 18 17:12:37.158432 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 477/916] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:37 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:37.998153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:37.998779 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:38.005077 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:38.005577 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:38.006068 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:38.006738 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:38.007166 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:38.007657 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:38.010410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:38.169939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:38.181393 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:38.182943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:38.197001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-32efb08c-2448-4a0f-bf23-10d09c2e2c40 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.202947 Aug 18 17:12:38.197912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 478/917] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:37 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:12:38.202744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:38.203355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:38.211078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:38.211598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:38.212212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:38.213089 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:38.213644 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:38.214769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:38.281709 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:38.290494 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1130c6ef-f3c5-4f24-96b4-743baaad94bc tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1144 microversion: 2.1 time: 0.091238 Aug 18 17:12:38.291829 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 479/918] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:38 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:39.220943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:39.221758 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:39.225400 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:39.230956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:39.231542 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:39.232030 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:39.232812 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:39.233224 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:39.233769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:39.370635 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:39.379976 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:39.381497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:39.382681 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f0d577f7-3585-46d8-b2ac-937bc4f7ba3d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.165770 Aug 18 17:12:39.383249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 480/919] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:39 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:12:39.388203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:39.389214 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:39.398169 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:39.398925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:39.399646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:39.400638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:39.401259 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:39.401980 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:39.468091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:39.476715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c87cd4eb-449c-4b19-a1b8-c1fea6bb3f30 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1144 microversion: 2.1 time: 0.092151 Aug 18 17:12:39.477406 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 481/920] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:39 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:40.407292 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:40.408052 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:40.414835 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:40.415323 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:40.415795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:40.416488 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:40.416946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:40.417371 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:40.549086 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:40.558218 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:40.559741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:40.562723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d0efee1d-4e88-48c4-9213-2a44735f0e72 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.157627 Aug 18 17:12:40.562723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 482/921] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:40 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:12:40.565825 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:40.566440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:40.572269 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:40.572759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:40.573206 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:40.573903 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:40.574360 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:40.574789 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:40.637621 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:40.645901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cf14b4a1-4ab7-4546-873c-5683d35027b4 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1144 microversion: 2.1 time: 0.082959 Aug 18 17:12:40.646478 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 483/922] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:40 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:41.583654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:41.584328 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:41.591034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:41.591660 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:41.592000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:41.592701 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:41.593157 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:41.593581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:41.722633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:41.730794 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:41.732325 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:41.733490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-182c3336-0f33-4ba4-bf8b-fe2f80ae41b4 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.153823 Aug 18 17:12:41.734056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 484/923] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:41 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 18 17:12:41.738461 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:41.739608 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:41.745230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:41.745716 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:41.746153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:41.746844 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:41.747303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:41.747761 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:41.826755 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:41.839424 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c7e04fb4-f2c2-4efe-be7c-3decea0248fa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1136 microversion: 2.1 time: 0.104174 Aug 18 17:12:41.840261 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 485/924] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:41 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1136 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:42.495245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6da9d0fe-55ce-4201-b6be-e9ddcaacdaa4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.891594 Aug 18 17:12:42.502633 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 440/925] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:12:36 2022] POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/os-volume_attachments => generated 194 bytes in 5893 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:42.758472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:42.759229 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:42.766190 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.766708 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.767176 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.767910 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.768860 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.769445 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.862258 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:42.864071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:42.873936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.880158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.880158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.880158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:42.880158 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:42.880568 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:42.899169 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:42.951109 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:42.958994 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a4aba36a-fd6e-477b-a30b-f6cc20f4efb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1200 microversion: 2.1 time: 0.101159 Aug 18 17:12:42.960677 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 441/926] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:42 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1200 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:42.969846 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:42.978625 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:42.980256 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:42.981627 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8cee108e-a377-45c3-858e-1bd7a0364ccb tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.228179 Aug 18 17:12:42.982334 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 486/927] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:42 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:43.134406 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:43.134406 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:43.141275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.142069 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.142712 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:43.143654 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.144275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.144903 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:43.231392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'services' on Instance uuid fe34c884-f87c-410a-a740-30046200620f {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:12:43.495780 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-900170d0-8e08-487d-8e03-5ab53f30b2d8 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments/65ef8a08-5e0a-4b67-a456-7250f24d73c8" status: 202 len: 0 microversion: 2.1 time: 0.370616 Aug 18 17:12:43.496652 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 442/928] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:12:43 2022] DELETE /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments/65ef8a08-5e0a-4b67-a456-7250f24d73c8 => generated 0 bytes in 372 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:12:43.505447 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-52997100-ea01-4368-ac18-501d1628661b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:43.507856 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-52997100-ea01-4368-ac18-501d1628661b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:43.514545 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52997100-ea01-4368-ac18-501d1628661b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.515019 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52997100-ea01-4368-ac18-501d1628661b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.515468 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52997100-ea01-4368-ac18-501d1628661b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:43.516183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52997100-ea01-4368-ac18-501d1628661b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.516631 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52997100-ea01-4368-ac18-501d1628661b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.517049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-52997100-ea01-4368-ac18-501d1628661b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:43.549255 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-52997100-ea01-4368-ac18-501d1628661b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048365 Aug 18 17:12:43.549833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 487/929] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:43 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:43.981341 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:43.982050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:43.988515 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.989854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.990483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:43.991198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:43.992081 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:43.992842 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.009955 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:44.018284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:44.018681 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.019186 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.019652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.020649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.021337 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.022007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.156067 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:44.165094 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:44.166690 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:44.167993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e54532f8-14c1-436a-84e6-705984190c79 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.162089 Aug 18 17:12:44.168661 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 488/930] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:44 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:44.244154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:44.252198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e74d3e17-f6f3-4797-86f4-319ed0578a5a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1278 microversion: 2.1 time: 0.275574 Aug 18 17:12:44.253245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 443/931] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:43 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1278 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:44.562236 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ccc7614e-9df9-406e-9b28-41932e247a70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:44.564452 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ccc7614e-9df9-406e-9b28-41932e247a70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:44.570423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccc7614e-9df9-406e-9b28-41932e247a70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.570967 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccc7614e-9df9-406e-9b28-41932e247a70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.571339 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccc7614e-9df9-406e-9b28-41932e247a70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.572076 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccc7614e-9df9-406e-9b28-41932e247a70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.572535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccc7614e-9df9-406e-9b28-41932e247a70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.572966 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ccc7614e-9df9-406e-9b28-41932e247a70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.603574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ccc7614e-9df9-406e-9b28-41932e247a70 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045284 Aug 18 17:12:44.604157 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 489/932] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:44 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:44.747254 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-5a1a1e88-4266-40dd-b29f-3a40e1e7235d req-217b6c18-5de1-49cc-b00c-d0aa6e11195e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7434d418-5586-4ce3-a420-21925506657c", "tag": "32c22de7-72ea-42f2-9fbf-c5873ac6f9a8"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:44.753861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:44.754657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=6 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:44.765863 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5a1a1e88-4266-40dd-b29f-3a40e1e7235d req-217b6c18-5de1-49cc-b00c-d0aa6e11195e service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:44.766626 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5a1a1e88-4266-40dd-b29f-3a40e1e7235d req-217b6c18-5de1-49cc-b00c-d0aa6e11195e service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:44.767190 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5a1a1e88-4266-40dd-b29f-3a40e1e7235d req-217b6c18-5de1-49cc-b00c-d0aa6e11195e service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:44.780575 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-5a1a1e88-4266-40dd-b29f-3a40e1e7235d req-217b6c18-5de1-49cc-b00c-d0aa6e11195e service nova] Creating event network-changed:32c22de7-72ea-42f2-9fbf-c5873ac6f9a8 for instance 7434d418-5586-4ce3-a420-21925506657c on hv-cinder-85367 Aug 18 17:12:44.786905 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-5a1a1e88-4266-40dd-b29f-3a40e1e7235d req-217b6c18-5de1-49cc-b00c-d0aa6e11195e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044923 Aug 18 17:12:44.793830 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 444/933] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:45.198953 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:45.199610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:45.206365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.206985 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.207666 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.208746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.209335 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.210112 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.284873 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:45.284873 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:45.290716 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.291528 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.292238 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.293132 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.293598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.294019 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.363575 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:45.372867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:45.374395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:45.375842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b7e495f0-1faf-4e78-8cc6-a909622a1f34 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.180992 Aug 18 17:12:45.377270 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 490/934] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:45 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:45.531595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:45.540141 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-341056f9-09ec-4a9e-9bac-8fbfeb7f3220 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1278 microversion: 2.1 time: 0.270044 Aug 18 17:12:45.540734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 445/935] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:45 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1278 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:45.618048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8223e412-7a6f-4f94-9dfc-4e6dc529d1ac tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:45.622070 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8223e412-7a6f-4f94-9dfc-4e6dc529d1ac tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:45.629164 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8223e412-7a6f-4f94-9dfc-4e6dc529d1ac tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.630023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8223e412-7a6f-4f94-9dfc-4e6dc529d1ac tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.630460 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8223e412-7a6f-4f94-9dfc-4e6dc529d1ac tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.631200 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8223e412-7a6f-4f94-9dfc-4e6dc529d1ac tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:45.631729 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8223e412-7a6f-4f94-9dfc-4e6dc529d1ac tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:45.632184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8223e412-7a6f-4f94-9dfc-4e6dc529d1ac tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:45.667182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8223e412-7a6f-4f94-9dfc-4e6dc529d1ac tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054984 Aug 18 17:12:45.667803 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 491/936] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:45 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:46.408049 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:46.408900 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:46.415845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.416329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.423458 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.423458 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.423458 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.423458 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.554170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:46.562117 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:46.570866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:46.571030 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:46.571137 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:46.571249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=4 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:46.571349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-eb0a7a6c-5970-47c9-8f8c-33b7cdab1a8d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.165002 Aug 18 17:12:46.571349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 446/937] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:46 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:46.571557 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.571557 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.571557 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.571838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.572137 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.572558 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.680823 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d27790c4-ae98-4318-a3d4-2076e38b3a90 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:46.683100 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d27790c4-ae98-4318-a3d4-2076e38b3a90 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:46.689797 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d27790c4-ae98-4318-a3d4-2076e38b3a90 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.690291 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d27790c4-ae98-4318-a3d4-2076e38b3a90 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.690781 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d27790c4-ae98-4318-a3d4-2076e38b3a90 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.691550 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d27790c4-ae98-4318-a3d4-2076e38b3a90 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.692113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d27790c4-ae98-4318-a3d4-2076e38b3a90 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.692539 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d27790c4-ae98-4318-a3d4-2076e38b3a90 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.708964 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:46.717966 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3b845094-9b76-4877-aeb7-f69dbf3ec999 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1278 microversion: 2.1 time: 0.159590 Aug 18 17:12:46.718908 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 492/938] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:46 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:46.747095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d27790c4-ae98-4318-a3d4-2076e38b3a90 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070896 Aug 18 17:12:46.748376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 447/939] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:46 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:46.805802 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-da505b69-d9fd-45e8-85f8-ee47c3c8adae req-a4e090d7-501a-46da-a4ca-691a919e90d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5400d9b3-34f6-451c-bb5c-ae2b231dcc5b", "name": "network-vif-plugged", "status": "completed", "tag": "6a4d4f56-49e2-4fd7-905b-4ed206d8d756"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:46.815141 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-da505b69-d9fd-45e8-85f8-ee47c3c8adae req-a4e090d7-501a-46da-a4ca-691a919e90d9 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:46.815681 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-da505b69-d9fd-45e8-85f8-ee47c3c8adae req-a4e090d7-501a-46da-a4ca-691a919e90d9 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:46.816115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-da505b69-d9fd-45e8-85f8-ee47c3c8adae req-a4e090d7-501a-46da-a4ca-691a919e90d9 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:46.827136 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-da505b69-d9fd-45e8-85f8-ee47c3c8adae req-a4e090d7-501a-46da-a4ca-691a919e90d9 service nova] Creating event network-vif-plugged:6a4d4f56-49e2-4fd7-905b-4ed206d8d756 for instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b on hv-cinder-85367 Aug 18 17:12:46.833108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-da505b69-d9fd-45e8-85f8-ee47c3c8adae req-a4e090d7-501a-46da-a4ca-691a919e90d9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030739 Aug 18 17:12:46.833715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 493/940] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:12:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:47.588558 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:47.589095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:47.595663 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:47.596321 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:47.596762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:47.597495 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:47.597972 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:47.599037 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:47.730112 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:47.738389 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:47.739931 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:47.740389 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:47.740639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:47.741098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e62699ca-f1fc-4212-8cbb-8b4ff4a2a4b9 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.156648 Aug 18 17:12:47.741665 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 448/941] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:47 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:47.747518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:47.748003 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:47.748441 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:47.749139 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:47.749610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:47.750019 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:47.762552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-597efd90-2329-445d-9785-df89c3618823 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:47.764751 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-597efd90-2329-445d-9785-df89c3618823 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:47.771184 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-597efd90-2329-445d-9785-df89c3618823 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:47.771711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-597efd90-2329-445d-9785-df89c3618823 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:47.772146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-597efd90-2329-445d-9785-df89c3618823 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:47.772853 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-597efd90-2329-445d-9785-df89c3618823 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:47.773312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-597efd90-2329-445d-9785-df89c3618823 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:47.773737 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-597efd90-2329-445d-9785-df89c3618823 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:47.808082 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-597efd90-2329-445d-9785-df89c3618823 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046603 Aug 18 17:12:47.808082 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 449/942] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:47 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:47.891799 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:47.899730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8d677b16-0c44-4789-b090-f28c2a87d6e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1278 microversion: 2.1 time: 0.163946 Aug 18 17:12:47.900304 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 494/943] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:47 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1278 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:48.766054 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:48.766775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:48.774759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.775281 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.775738 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.776439 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.776893 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.782178 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.818821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b0cfd365-f329-470f-8ef1-11712c397692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:48.821148 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b0cfd365-f329-470f-8ef1-11712c397692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:48.828311 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0cfd365-f329-470f-8ef1-11712c397692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.828837 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0cfd365-f329-470f-8ef1-11712c397692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.829279 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0cfd365-f329-470f-8ef1-11712c397692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.830000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0cfd365-f329-470f-8ef1-11712c397692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.830444 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0cfd365-f329-470f-8ef1-11712c397692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.830867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-b0cfd365-f329-470f-8ef1-11712c397692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.846365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:48.867177 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b0cfd365-f329-470f-8ef1-11712c397692 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052808 Aug 18 17:12:48.868434 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 495/944] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:48 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:12:48.921741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:48.922513 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:48.929410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.929963 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.930426 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.931093 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:48.931263 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:48.931607 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:48.932256 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:48.940732 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:48.946560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:48.946560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0c57956c-c179-491b-acac-d50f6d7e23e0 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1730 microversion: 2.20 time: 0.182903 Aug 18 17:12:48.946560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 450/945] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:48 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:49.069247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:49.077061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ef170298-26c7-4527-9940-0e9ccdec415f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1278 microversion: 2.1 time: 0.159963 Aug 18 17:12:49.077638 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 496/946] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:48 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1278 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:49.879963 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-571fa062-59c1-4cce-bdfb-f5b989036c25 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:49.882396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-571fa062-59c1-4cce-bdfb-f5b989036c25 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:49.889176 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-571fa062-59c1-4cce-bdfb-f5b989036c25 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.889679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-571fa062-59c1-4cce-bdfb-f5b989036c25 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.890670 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-571fa062-59c1-4cce-bdfb-f5b989036c25 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:49.891365 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-571fa062-59c1-4cce-bdfb-f5b989036c25 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.892419 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-571fa062-59c1-4cce-bdfb-f5b989036c25 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.892888 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-571fa062-59c1-4cce-bdfb-f5b989036c25 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:49.925117 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-571fa062-59c1-4cce-bdfb-f5b989036c25 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049026 Aug 18 17:12:49.925696 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 451/947] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:49 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:49.968127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:49.968757 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:49.975849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.976339 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.976778 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:49.977497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:49.977951 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:49.978374 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.099649 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:50.100274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:50.107788 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:50.108280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:50.108715 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.109444 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:50.109905 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:50.110330 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.114899 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:50.123224 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:50.124774 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:50.125962 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c24c75ca-4b3c-4d03-84f1-0a511c2cb5b3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1717 microversion: 2.20 time: 0.162365 Aug 18 17:12:50.126533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 497/948] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:12:49 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:12:50.249888 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:50.260780 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-136a27f4-3c66-48ae-8652-5edda4e78ba6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1278 microversion: 2.1 time: 0.166569 Aug 18 17:12:50.270047 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 452/949] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:50 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1278 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:50.937793 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0c88edec-9ce2-45d7-9a67-4566e0aa4013 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:50.940220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0c88edec-9ce2-45d7-9a67-4566e0aa4013 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:50.947530 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c88edec-9ce2-45d7-9a67-4566e0aa4013 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:50.948060 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c88edec-9ce2-45d7-9a67-4566e0aa4013 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:50.948502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c88edec-9ce2-45d7-9a67-4566e0aa4013 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.949213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c88edec-9ce2-45d7-9a67-4566e0aa4013 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:50.949673 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c88edec-9ce2-45d7-9a67-4566e0aa4013 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:50.950101 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0c88edec-9ce2-45d7-9a67-4566e0aa4013 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:50.980944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0c88edec-9ce2-45d7-9a67-4566e0aa4013 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047181 Aug 18 17:12:50.981632 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 498/950] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:50 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:51.116083 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b86c253c-3de9-4ff0-9435-d5630c40cef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:51.122655 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b86c253c-3de9-4ff0-9435-d5630c40cef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.123143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b86c253c-3de9-4ff0-9435-d5630c40cef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.123621 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b86c253c-3de9-4ff0-9435-d5630c40cef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.185979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b86c253c-3de9-4ff0-9435-d5630c40cef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Going to try to stop instance {{(pid=121268) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 17:12:51.281787 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:51.282396 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:51.288987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.289402 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.289840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.290530 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.290992 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.291417 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.375559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b86c253c-3de9-4ff0-9435-d5630c40cef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/action" status: 202 len: 0 microversion: 2.1 time: 0.262968 Aug 18 17:12:51.377324 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 453/951] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:12:51 2022] POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:12:51.390721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:51.391886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:51.399646 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.400143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.400579 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.401279 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:51.401742 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:51.402147 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:51.452485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:51.460568 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-917e4c5c-a809-44f4-a8a5-f4807c9c1695 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1278 microversion: 2.1 time: 0.182514 Aug 18 17:12:51.461299 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 499/952] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:51 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1278 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:51.550207 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:51.559202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-09fc973d-3a8c-47b9-9130-35744611fa81 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.175695 Aug 18 17:12:51.559802 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 454/953] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:51 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:51.993885 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-34abd905-c8fe-481a-afaf-c3a31f292afc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:51.996269 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-34abd905-c8fe-481a-afaf-c3a31f292afc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:52.002848 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-34abd905-c8fe-481a-afaf-c3a31f292afc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.003405 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-34abd905-c8fe-481a-afaf-c3a31f292afc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.003865 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-34abd905-c8fe-481a-afaf-c3a31f292afc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.005220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-34abd905-c8fe-481a-afaf-c3a31f292afc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.005715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-34abd905-c8fe-481a-afaf-c3a31f292afc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.006140 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-34abd905-c8fe-481a-afaf-c3a31f292afc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.036862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-34abd905-c8fe-481a-afaf-c3a31f292afc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046977 Aug 18 17:12:52.037605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 500/954] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:51 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:52.484956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:52.485609 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:52.492650 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.493135 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.493571 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.494261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.494718 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.495145 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.580133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:52.580928 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:52.586990 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.587606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.588103 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.588866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:52.589407 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:52.589821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:52.625835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:52.633599 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3047a720-7430-43b6-bab4-0385a32fc9ab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.152446 Aug 18 17:12:52.634189 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 455/955] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:52 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:52.718507 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:52.727405 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0ca65113-fcc4-4d33-ae3d-a1eac9189308 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.151103 Aug 18 17:12:52.728001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 501/956] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:52 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:53.054114 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-70d8a82a-b766-431d-a46d-bfe88682397f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:53.056291 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-70d8a82a-b766-431d-a46d-bfe88682397f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:53.062485 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70d8a82a-b766-431d-a46d-bfe88682397f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.062972 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70d8a82a-b766-431d-a46d-bfe88682397f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.063405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70d8a82a-b766-431d-a46d-bfe88682397f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.064208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70d8a82a-b766-431d-a46d-bfe88682397f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.064589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70d8a82a-b766-431d-a46d-bfe88682397f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.065095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70d8a82a-b766-431d-a46d-bfe88682397f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.096954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-70d8a82a-b766-431d-a46d-bfe88682397f tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046883 Aug 18 17:12:53.097680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 456/957] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:12:53 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:12:53.159211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:53.159747 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:53.166314 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.166799 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.167241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.168061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.168529 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.168958 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.194725 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:12:53.541809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-dcb549b0-5f2c-4ce0-ab63-3356d91cfb09 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 204 len: 0 microversion: 2.1 time: 0.386173 Aug 18 17:12:53.542429 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 502/958] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:12:53 2022] DELETE /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:12:53.550575 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:53.551868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:53.558439 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.558924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.559357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.560082 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.560538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.560962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.565290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:53.656068 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:53.656866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:53.663189 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.663710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.664143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.665347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.665347 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.668212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.696779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:53.703635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-942ca065-2ac2-46aa-bf06-0a977cff5884 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1681 microversion: 2.1 time: 0.156886 Aug 18 17:12:53.704219 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 457/959] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:53 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:53.748344 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:53.749384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:53.755698 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.756192 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.756814 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.757529 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:53.757992 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:53.758421 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:53.804953 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:53.812598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ffeed537-3c09-4264-bee8-b8d6c387583d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.161032 Aug 18 17:12:53.813165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 503/960] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:53 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:53.887635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:53.895796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-771d54cb-fbcb-4a46-b2a0-8ae120edb9ac tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.151728 Aug 18 17:12:53.896372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 458/961] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:53 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:54.724587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:54.725204 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:54.731659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.732145 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.732581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.733273 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.733734 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.734159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.834155 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:54.835304 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:54.842924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.843424 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.844349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.844720 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.845195 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.845622 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.863827 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:54.871466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8122b816-c57b-40e9-9393-00ddbd1246c5 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1681 microversion: 2.1 time: 0.150808 Aug 18 17:12:54.872067 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 504/962] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:54 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:54.916656 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:54.917411 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:54.923378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.923903 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.924346 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.925051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:54.925512 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:54.926489 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:54.983538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:54.992544 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-247ecf79-d620-4b50-b48d-7007d9c4c3e0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.163393 Aug 18 17:12:54.993130 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 459/963] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:54 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:55.059977 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:55.069067 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-386d371f-b5c7-44a9-ad75-2e2542ad7bd0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.156219 Aug 18 17:12:55.069649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 505/964] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:54 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:55.892710 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:55.893324 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:55.900231 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:55.900714 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:55.901142 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:55.901826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:55.902301 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:55.902692 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.015065 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:56.015753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:56.024984 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:56.025853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:56.026634 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.027368 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:56.027878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:56.028333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.143218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:56.152088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4c48fafc-2dd1-4ab8-adda-fe1c599ff96d tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1681 microversion: 2.1 time: 0.263053 Aug 18 17:12:56.153050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 460/965] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:55 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1681 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:56.172073 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:56.172711 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:56.179091 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:56.179629 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:56.180074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.180790 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:56.181366 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:56.181681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.418377 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:56.427170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fea6b216-eaaa-4665-bd89-8dd64a9d1d8b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.261877 Aug 18 17:12:56.427796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 461/966] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:56 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:56.432487 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-695dcfa9-eee3-488e-a624-e67cb0a52763 req-bbdaace5-215f-44cb-9b6e-406de83b86bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe34c884-f87c-410a-a740-30046200620f", "name": "network-vif-deleted", "tag": "163f8304-d484-49c9-8968-b436b23114d7"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:12:56.441864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:56.450112 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a880302e-0b21-4135-9c9c-4fe7fc8339da tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.439902 Aug 18 17:12:56.450902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 506/967] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:56 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:56.455942 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-695dcfa9-eee3-488e-a624-e67cb0a52763 req-bbdaace5-215f-44cb-9b6e-406de83b86bb service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:56.456453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-695dcfa9-eee3-488e-a624-e67cb0a52763 req-bbdaace5-215f-44cb-9b6e-406de83b86bb service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:56.456879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-695dcfa9-eee3-488e-a624-e67cb0a52763 req-bbdaace5-215f-44cb-9b6e-406de83b86bb service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:56.469917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-695dcfa9-eee3-488e-a624-e67cb0a52763 req-bbdaace5-215f-44cb-9b6e-406de83b86bb service nova] Creating event network-vif-deleted:163f8304-d484-49c9-8968-b436b23114d7 for instance fe34c884-f87c-410a-a740-30046200620f on hv-cinder-85367 Aug 18 17:12:56.475985 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-695dcfa9-eee3-488e-a624-e67cb0a52763 req-bbdaace5-215f-44cb-9b6e-406de83b86bb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046806 Aug 18 17:12:56.484604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 462/968] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:12:57.178640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:57.179307 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:57.186026 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.186511 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.186948 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.187688 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.188150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.188574 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.221939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.222420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.222888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.223342 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lazy-loading 'fault' on Instance uuid fe34c884-f87c-410a-a740-30046200620f {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:12:57.266172 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fec6bdfe9ee4e839efaf7a1c083c31d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4eececcd804446e49078038ab362b235', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:57.274037 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-aa95bcf5-372a-416b-920f-e742e8b2d37b tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 200 len: 1331 microversion: 2.1 time: 0.099754 Aug 18 17:12:57.274620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 507/969] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:57 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 1331 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:57.450207 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:57.450918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:57.457237 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.457736 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.458178 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.458914 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.459379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.459829 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.471637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:57.472569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:57.479087 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.479651 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.480086 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.480788 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:57.481243 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:57.481665 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:57.609235 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:57.617552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-40353ed3-39a5-4e8f-85fe-284812bfa54c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.172133 Aug 18 17:12:57.618156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 463/970] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:57 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:57.624816 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:57.633195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8c0bc6cf-55dd-4df2-9c94-79498b173c01 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.165762 Aug 18 17:12:57.633760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 508/971] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:57 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:58.294181 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:58.294832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:58.300888 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.301373 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.301811 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.302503 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.302958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.303386 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.316885 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f HTTP/1.1 Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:12:58.318526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:12:58.323910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': 'fe34c884-f87c-410a-a740-30046200620f'} Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:12:58.325015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:12:58.326618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:12:58.327983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:12:58.327983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7d8f64e8-43e6-4d9b-aaf8-b0954965e1d2 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 404 len: 111 microversion: 2.1 time: 0.029704 Aug 18 17:12:58.327983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 464/972] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:58 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:12:58.336778 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-723e9aa2-3c29-4d3f-bffb-2dd62410f6a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '.version_select at 0x7ff5b4ba34c0>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:58.440335 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-723e9aa2-3c29-4d3f-bffb-2dd62410f6a1 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675144905" status: 202 len: 0 microversion: 2.1 time: 0.108009 Aug 18 17:12:58.440965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 509/973] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Aug 18 17:12:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1675144905 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:12:58.649428 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:58.650120 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:58.654126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:58.654751 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:58.656909 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.657402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.657826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.658545 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.658997 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.659607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.661137 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.661636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.662081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.662796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:58.663252 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:58.663702 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:58.826343 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:58.834767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d1db55c8-e31f-4759-8255-9332a38c5451 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.184601 Aug 18 17:12:58.835345 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 510/974] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:58 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:12:58.855808 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:12:58.864689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-26ba8668-3689-4e1f-b3db-99662125d812 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.219846 Aug 18 17:12:58.865271 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 465/975] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:58 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:12:59.855730 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:59.856263 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:59.862674 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.863245 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.864201 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:59.864907 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.865369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.865795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:59.868608 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:12:59.894601 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:12:59.895240 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:12:59.902404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.902909 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.912600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:12:59.912600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:12:59.912600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:12:59.912600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:00.014132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:00.022727 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-97d35dfa-e5d7-4021-a88e-350f79e3cf63 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.170926 Aug 18 17:13:00.023354 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 511/976] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:59 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:00.059061 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:00.067986 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a089a8c0-bc25-4a0f-80b8-0bef4e943c71 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.177150 Aug 18 17:13:00.068634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 466/977] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:12:59 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:00.646849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:00.647346 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:00.655327 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:00.656380 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:00.657136 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:00.658422 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:00.659224 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:00.660491 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:00.676391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f HTTP/1.1 Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:13:00.678078 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.679685 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': 'fe34c884-f87c-410a-a740-30046200620f'} Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:00.680587 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.681889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.683340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:00.683340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ac7ed1f5-c030-48ae-9b51-b014f167c475 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 404 len: 111 microversion: 2.1 time: 0.036528 Aug 18 17:13:00.683340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 512/978] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:13:00 2022] DELETE /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:13:00.688376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:00.689001 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: fe34c884-f87c-410a-a740-30046200620f] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:00.695372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:00.695903 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:00.696341 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:00.697036 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:00.697497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:00.697926 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:00.711537 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f HTTP/1.1 Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:13:00.713092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.714644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': 'fe34c884-f87c-410a-a740-30046200620f'} Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:00.715615 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. Aug 18 17:13:00.717134 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:00.721310 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance fe34c884-f87c-410a-a740-30046200620f could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:00.721310 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7b31966a-ad37-4a41-8030-6d05de1b69a4 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f" status: 404 len: 111 microversion: 2.1 time: 0.030674 Aug 18 17:13:00.721310 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 467/979] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:00 2022] GET /compute/v2.1/servers/fe34c884-f87c-410a-a740-30046200620f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:13:01.046502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:01.047092 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:01.054070 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:01.054575 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:01.055020 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:01.055767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:01.056228 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:01.056712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:01.088764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:01.089384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:01.096156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:01.096644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:01.097276 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:01.098017 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:01.098497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:01.098908 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:01.194862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:01.203115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-8a2dc4d9-1ab4-482b-b734-39fb744f8379 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.160748 Aug 18 17:13:01.203847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 513/980] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:01 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:01.238030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:01.247617 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-dabb6608-6b8c-42ce-9278-8d540a9d026d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.162582 Aug 18 17:13:01.248250 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 468/981] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:01 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:02.001331 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:02.001880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:02.008357 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.008842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.009308 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.010471 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.010768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.011969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.027281 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 HTTP/1.1 Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:13:02.030195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.031852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': 'da756d85-46a8-4afd-bfbc-4e20051f6d10'} Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:02.032742 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.034365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.036025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:02.036025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d504e77d-bcf6-4165-8916-380b2831b27e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 404 len: 111 microversion: 2.1 time: 0.034897 Aug 18 17:13:02.036025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 514/982] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:13:01 2022] DELETE /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:13:02.043605 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:02.044217 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: da756d85-46a8-4afd-bfbc-4e20051f6d10] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:02.050206 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.050682 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.051116 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.051833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.052289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.052709 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.067898 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 HTTP/1.1 Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:13:02.069482 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.071050 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': 'da756d85-46a8-4afd-bfbc-4e20051f6d10'} Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:02.071820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. Aug 18 17:13:02.073170 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.074255 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance da756d85-46a8-4afd-bfbc-4e20051f6d10 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:02.074255 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c764293c-8f3b-4669-97bd-30879675c0dc tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10" status: 404 len: 111 microversion: 2.1 time: 0.031282 Aug 18 17:13:02.074255 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 469/983] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:02 2022] GET /compute/v2.1/servers/da756d85-46a8-4afd-bfbc-4e20051f6d10 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:13:02.081191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:02.081703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:02.088472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.088949 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.089379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.090071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.090523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.090941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.106509 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de HTTP/1.1 Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:13:02.108147 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.109670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de'} Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:02.110535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.111999 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.113576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:02.113576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c8f6e27d-2255-4ad0-a5c3-5e067d2a44a9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 404 len: 111 microversion: 2.1 time: 0.033916 Aug 18 17:13:02.113576 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 515/984] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:13:02 2022] DELETE /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:13:02.118082 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:02.118707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:02.125252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.125776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.126216 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.126911 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.127371 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.127832 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.141820 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de HTTP/1.1 Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:13:02.143329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.145570 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de'} Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:02.146449 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. Aug 18 17:13:02.147941 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:02.149261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance 0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:02.149261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-de87b7f9-d36e-4ff8-a227-2dd5bba28309 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de" status: 404 len: 111 microversion: 2.1 time: 0.030607 Aug 18 17:13:02.149261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 470/985] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:02 2022] GET /compute/v2.1/servers/0bf6732e-dbe6-4fb3-8b9d-ed3387bf01de => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:13:02.224874 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:02.225487 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:02.231357 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.231896 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.232361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.233023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.233472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.233889 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.270492 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:02.271420 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:02.277782 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.278279 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.278727 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.279465 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.280094 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.280788 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:02.388207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:02.397620 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7704f2ab-1519-49be-aba2-87493ebc716f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.177430 Aug 18 17:13:02.398195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 516/986] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:02 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:02.528384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:02.536739 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e5315a39-2853-424f-8b28-ed893dc115f9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.270713 Aug 18 17:13:02.537326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 471/987] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:02 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:02.984499 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-008e57d4-56de-493f-a8d6-4bd869c8e7c3 req-fbf154b0-449c-4baa-8403-8637afe19145 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7434d418-5586-4ce3-a420-21925506657c", "name": "network-vif-plugged", "status": "completed", "tag": "32c22de7-72ea-42f2-9fbf-c5873ac6f9a8"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:02.996116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-008e57d4-56de-493f-a8d6-4bd869c8e7c3 req-fbf154b0-449c-4baa-8403-8637afe19145 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:02.996809 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-008e57d4-56de-493f-a8d6-4bd869c8e7c3 req-fbf154b0-449c-4baa-8403-8637afe19145 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:02.997255 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-008e57d4-56de-493f-a8d6-4bd869c8e7c3 req-fbf154b0-449c-4baa-8403-8637afe19145 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.009649 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-008e57d4-56de-493f-a8d6-4bd869c8e7c3 req-fbf154b0-449c-4baa-8403-8637afe19145 service nova] Creating event network-vif-plugged:32c22de7-72ea-42f2-9fbf-c5873ac6f9a8 for instance 7434d418-5586-4ce3-a420-21925506657c on hv-cinder-85367 Aug 18 17:13:03.015215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-008e57d4-56de-493f-a8d6-4bd869c8e7c3 req-fbf154b0-449c-4baa-8403-8637afe19145 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034423 Aug 18 17:13:03.016085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 517/988] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:03.417662 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:03.418379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:03.419017 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:03.419740 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:03.426969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.427759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.428033 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.428553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.428796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.429381 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.429749 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.430305 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.430532 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.431189 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.431525 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.432095 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.466779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:13:03.582344 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:03.590361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-deacbff6-1072-4c52-9b7b-1397af30e429 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.175931 Aug 18 17:13:03.591358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 518/989] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:03 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:03.595951 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-84c49a63-1e2d-40d9-a1a1-ab7d94da7988 req-0646ee77-b47e-44ff-b6e4-f77e45a071d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1", "tag": "60e0cf05-5e8f-4133-8579-da77a04a4d8a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:03.608718 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-84c49a63-1e2d-40d9-a1a1-ab7d94da7988 req-0646ee77-b47e-44ff-b6e4-f77e45a071d3 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.609191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-84c49a63-1e2d-40d9-a1a1-ab7d94da7988 req-0646ee77-b47e-44ff-b6e4-f77e45a071d3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.609616 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-84c49a63-1e2d-40d9-a1a1-ab7d94da7988 req-0646ee77-b47e-44ff-b6e4-f77e45a071d3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.625749 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-84c49a63-1e2d-40d9-a1a1-ab7d94da7988 req-0646ee77-b47e-44ff-b6e4-f77e45a071d3 service nova] Creating event network-changed:60e0cf05-5e8f-4133-8579-da77a04a4d8a for instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 on hv-cinder-85367 Aug 18 17:13:03.631195 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-84c49a63-1e2d-40d9-a1a1-ab7d94da7988 req-0646ee77-b47e-44ff-b6e4-f77e45a071d3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038575 Aug 18 17:13:03.633493 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 519/990] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:03.638656 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:03.639238 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:03.645289 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.645753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.646184 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.647009 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.647505 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.647941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.661854 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 HTTP/1.1 Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:13:03.663556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.670034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': 'e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989'} Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:03.670807 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.672274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.673654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:03.673654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f1f1629d-91e6-4748-9c57-b22d28cff3f9 tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 404 len: 111 microversion: 2.1 time: 0.031617 Aug 18 17:13:03.673654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 520/991] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:13:03 2022] DELETE /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:13:03.673654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:03.673654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:03.677588 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.678070 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.678502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.679192 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.679677 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.680255 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.725682 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c5995b4f-206f-4c85-bf74-81f6a3764ad6 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "DELETE /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 204 len: 0 microversion: 2.1 time: 0.314741 Aug 18 17:13:03.726477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 472/992] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:13:03 2022] DELETE /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:13:03.734265 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:03.734982 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] [instance: e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:03.742031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.742531 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.743026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.743764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.744252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.744698 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.787408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] HTTP exception thrown: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Request method failure captured: Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 HTTP/1.1 Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFcJaKrV5KFPpreBp5AKNe5SAKNUCL8SdhkxB6qbag159JjaTEkT6Ult6uneTmsdyYK5FmSS37kf3KNWcpXQA5DGP9nGhQoh3l_xRi5wbdRsc5OKQGLbifOsNX0sWPunK_6x6vrPe-t60n35gSAIDvCexEoMvzGRq3FEVejgalgCMk Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:13:03.789441 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4eececcd804446e49078038ab362b235"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4eececcd804446e49078038ab362b235"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4eececcd804446e49078038ab362b235", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 4eececcd804446e49078038ab362b235 Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-215553972 Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 1fec6bdfe9ee4e839efaf7a1c083c31d Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeNegativeTest-215553972-project Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.791284 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': 'e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989'} Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:03.792312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. Aug 18 17:13:03.794274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:03.797164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] Returning 404 to user: Instance e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:03.797164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0b8abfa0-1202-424f-b112-106e1f59d50e tempest-AttachVolumeNegativeTest-215553972 tempest-AttachVolumeNegativeTest-215553972-project] 10.222.0.78 "GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989" status: 404 len: 111 microversion: 2.1 time: 0.063084 Aug 18 17:13:03.797164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 473/993] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:03 2022] GET /compute/v2.1/servers/e5db7d29-d5ce-4cfc-b0ce-c4bef4fcb989 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:13:03.797606 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:03.798047 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:03.805986 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.806728 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.807326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.808501 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:03.809254 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:03.810258 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:03.866552 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:03.876652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f80559a1-6280-4cad-a70d-320de4cee2a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.210116 Aug 18 17:13:03.890865 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 521/994] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:03 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:03.966863 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:03.977043 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7f9a9e33-e242-4d06-b6a6-a5b6146315e5 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.183752 Aug 18 17:13:03.977776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 474/995] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:03 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:04.611497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:04.612113 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:04.618495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.618967 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.619395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:04.620120 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.620567 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.620982 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:04.818330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:04.826050 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6213cefd-1cae-47b9-86c0-25ccf13b6f69 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1266 microversion: 2.1 time: 0.218452 Aug 18 17:13:04.826712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 522/996] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:04 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1266 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:04.897935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:04.898531 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:04.900935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:04.905577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.908608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.908608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:04.908608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:04.908608 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:04.908972 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:05.005967 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:05.006777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:05.014842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:05.015681 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:05.016367 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:05.017346 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:05.018047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:05.018700 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:05.123115 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:05.132071 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1e9179e7-3aad-4713-825c-9e693f6ebc2d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.237877 Aug 18 17:13:05.132789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 475/997] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:04 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:05.281954 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:05.289746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e8386089-db68-4b64-8e80-561095af9044 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.292255 Aug 18 17:13:05.290966 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 523/998] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:04 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:05.846268 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:05.846888 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:05.852992 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:05.853480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:05.853954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:05.855384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:05.855872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:05.856300 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:05.861563 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:06.069847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:06.078972 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-771e4a13-a271-4a44-9f06-f84f5f997c78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1453 microversion: 2.1 time: 0.236584 Aug 18 17:13:06.082328 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 476/999] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:05 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1453 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:06.103567 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:06.104877 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:06.112426 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.113300 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.114094 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.115268 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.115978 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.117056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.154203 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:06.155290 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:06.165565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.169433 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.170015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.170858 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.174031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.174585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.380513 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:06.393403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4909a0ca-d1ca-49ab-bfd6-82c34b9e6689 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1723 microversion: 2.1 time: 0.239505 Aug 18 17:13:06.393403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 477/1000] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:06 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:06.395919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:06.396717 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:06.403303 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.403840 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.404274 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.404974 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:06.405683 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:06.406105 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:06.538726 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:06.542082 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:06.548208 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-64820a81-f1d4-40e6-912d-0301f8ebf332 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1453 microversion: 2.1 time: 0.448466 Aug 18 17:13:06.549064 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 524/1001] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:06 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1453 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:06.550405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3e39cbaf-a5af-40a3-8318-5bef1134ed49 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1566 microversion: 2.1 time: 0.159257 Aug 18 17:13:06.551041 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 478/1002] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:06 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:07.388222 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-364b69dc-4f11-451e-9081-8a00818378cf req-947d994a-2f7e-44eb-90bd-92187be1d3fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1", "name": "network-vif-deleted", "tag": "60e0cf05-5e8f-4133-8579-da77a04a4d8a"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:07.388222 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:07.391025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-364b69dc-4f11-451e-9081-8a00818378cf req-947d994a-2f7e-44eb-90bd-92187be1d3fa service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.391533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-364b69dc-4f11-451e-9081-8a00818378cf req-947d994a-2f7e-44eb-90bd-92187be1d3fa service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.392106 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-364b69dc-4f11-451e-9081-8a00818378cf req-947d994a-2f7e-44eb-90bd-92187be1d3fa service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.404502 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-364b69dc-4f11-451e-9081-8a00818378cf req-947d994a-2f7e-44eb-90bd-92187be1d3fa service nova] Creating event network-vif-deleted:60e0cf05-5e8f-4133-8579-da77a04a4d8a for instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 on hv-cinder-85367 Aug 18 17:13:07.412815 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:07.431961 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:07.432887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-364b69dc-4f11-451e-9081-8a00818378cf req-947d994a-2f7e-44eb-90bd-92187be1d3fa service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042328 Aug 18 17:13:07.432887 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 525/1003] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:07.433030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.433030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.433030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.433030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.433320 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.433320 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.578470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:07.579787 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:07.589597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.591290 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.592276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.593319 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.594781 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.596679 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.604607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:07.619723 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-cc0192af-8f11-4593-a56b-00459a9b3d27 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1700 microversion: 2.1 time: 0.206386 Aug 18 17:13:07.634442 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 479/1004] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:07 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1700 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:13:07.647559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-321110f8-3356-48ac-a40f-4b7bc5e15390 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:07.658322 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-321110f8-3356-48ac-a40f-4b7bc5e15390 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:07.658815 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-321110f8-3356-48ac-a40f-4b7bc5e15390 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:07.662101 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-321110f8-3356-48ac-a40f-4b7bc5e15390 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:07.714020 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-321110f8-3356-48ac-a40f-4b7bc5e15390 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Going to try to start instance {{(pid=121268) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 17:13:07.758456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:07.772771 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-491eeb99-c317-435c-aa5f-f4a9543a97c0 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1220 microversion: 2.1 time: 0.200369 Aug 18 17:13:07.774015 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 526/1005] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:07 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1220 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:07.986195 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-321110f8-3356-48ac-a40f-4b7bc5e15390 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/action" status: 202 len: 0 microversion: 2.1 time: 0.342574 Aug 18 17:13:08.008445 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 480/1006] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:13:07 2022] POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:13:08.017564 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:08.018363 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:08.026593 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.027659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.028294 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.029323 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.029787 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.030403 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.353433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:08.377995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f5d22fb3-b1e4-472b-b7f6-8ada34611bd2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1709 microversion: 2.1 time: 0.368256 Aug 18 17:13:08.379183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 527/1007] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:08 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1709 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:08.795401 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:08.799594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:08.817172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.818078 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.818770 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.819861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.820742 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.821548 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.870907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:08.871569 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:08.872196 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:08.872716 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lazy-loading 'fault' on Instance uuid 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:13:08.955414 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99010fd86e3b4bf59fc39716d208f06f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e5d8cae49e524a98ae646381b455351e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:08.966575 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b573fefe-901e-4183-9c03-3357e2e7b161 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 200 len: 1225 microversion: 2.1 time: 0.175940 Aug 18 17:13:08.967172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 481/1008] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:08 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 1225 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:09.405853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:09.406451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:09.414362 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:09.414847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:09.415273 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:09.415995 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:09.416441 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:09.416865 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:09.647096 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:09.655511 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d506c9a0-721a-4768-ad19-0b5a374fef68 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1709 microversion: 2.1 time: 0.253463 Aug 18 17:13:09.656100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 528/1009] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:09 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1709 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:09.998342 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:09.998913 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] [instance: 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:10.005938 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.012514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.012514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.012514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.012514 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.012873 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.022540 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] HTTP exception thrown: Instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 could not be found. Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Request method failure captured: Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 HTTP/1.1 Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nHL4-PPwRgmG2dx4tLeLsxEK7vCQib6DcCJZmpfYC-deMaXp5_Ng_kfA-E1EapvvbnHfuwVAwd4kS2VrBUW13km-gbOmOnG_9Cagk-B9sVI0ksUBROZJTxwmijaDejpOHbGUCYU85hGufiTXVd5wAF1nObBzyUF2O9KZIOwOWmN2bQ Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: e5d8cae49e524a98ae646381b455351e Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-TestShelveInstance-570234085 Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:13:10.024218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5d8cae49e524a98ae646381b455351e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e5d8cae49e524a98ae646381b455351e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e5d8cae49e524a98ae646381b455351e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e5d8cae49e524a98ae646381b455351e", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-TestShelveInstance-570234085 Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: e5d8cae49e524a98ae646381b455351e Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-TestShelveInstance-570234085 Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-TestShelveInstance-570234085-project Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 99010fd86e3b4bf59fc39716d208f06f Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-TestShelveInstance-570234085-project Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 could not be found. Aug 18 17:13:10.025772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1'} Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 could not be found. Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:10.026536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 could not be found. Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 could not be found. Aug 18 17:13:10.027793 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:10.028912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Returning 404 to user: Instance 66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:10.028912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-19a30a3f-a0ff-436c-943b-9725a2e96c01 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1" status: 404 len: 111 microversion: 2.1 time: 0.031387 Aug 18 17:13:10.028912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 482/1010] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:09 2022] GET /compute/v2.1/servers/66904e9a-92a1-4e2b-bc4b-6d773f8ca0e1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:13:10.080838 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-84e12ef3-8270-4d4f-88a0-e1c2be7000a8 req-decca5f6-8c02-4b68-9fb7-e21936db65d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7434d418-5586-4ce3-a420-21925506657c", "tag": "32c22de7-72ea-42f2-9fbf-c5873ac6f9a8"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:10.096839 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-84e12ef3-8270-4d4f-88a0-e1c2be7000a8 req-decca5f6-8c02-4b68-9fb7-e21936db65d2 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.097146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-84e12ef3-8270-4d4f-88a0-e1c2be7000a8 req-decca5f6-8c02-4b68-9fb7-e21936db65d2 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.097777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-84e12ef3-8270-4d4f-88a0-e1c2be7000a8 req-decca5f6-8c02-4b68-9fb7-e21936db65d2 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.110595 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-84e12ef3-8270-4d4f-88a0-e1c2be7000a8 req-decca5f6-8c02-4b68-9fb7-e21936db65d2 service nova] Creating event network-changed:32c22de7-72ea-42f2-9fbf-c5873ac6f9a8 for instance 7434d418-5586-4ce3-a420-21925506657c on hv-cinder-85367 Aug 18 17:13:10.116659 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-84e12ef3-8270-4d4f-88a0-e1c2be7000a8 req-decca5f6-8c02-4b68-9fb7-e21936db65d2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039934 Aug 18 17:13:10.117270 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 529/1011] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:13:10.414332 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8ab55d51-2dc1-4e2d-85c0-00516a5e5a97 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] Calling method '.version_select at 0x7ff5b4c4e550>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:10.555919 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8ab55d51-2dc1-4e2d-85c0-00516a5e5a97 tempest-TestShelveInstance-570234085 tempest-TestShelveInstance-570234085-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1795979929" status: 202 len: 0 microversion: 2.1 time: 0.145774 Aug 18 17:13:10.557300 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 483/1012] 10.222.0.78 () {58 vars in 1254 bytes} [Thu Aug 18 17:13:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1795979929 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:13:10.681513 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:10.683173 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:10.698469 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.700943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.702761 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.704609 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:10.708427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:10.709005 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:10.922791 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:10.932826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c0588fb1-ea4a-4805-b60d-9ea177c59975 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1713 microversion: 2.1 time: 0.258516 Aug 18 17:13:10.933798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 530/1013] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:10 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1713 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:23.536841 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:23.537613 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:23.541692 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7dfa8f6e-274a-45a2-8977-4d29dc4a15a3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:23.543923 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-7dfa8f6e-274a-45a2-8977-4d29dc4a15a3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:23.551349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7dfa8f6e-274a-45a2-8977-4d29dc4a15a3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:23.551938 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7dfa8f6e-274a-45a2-8977-4d29dc4a15a3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:23.552379 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7dfa8f6e-274a-45a2-8977-4d29dc4a15a3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:23.553085 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7dfa8f6e-274a-45a2-8977-4d29dc4a15a3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:23.553549 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7dfa8f6e-274a-45a2-8977-4d29dc4a15a3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:23.553972 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-7dfa8f6e-274a-45a2-8977-4d29dc4a15a3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:23.586466 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7dfa8f6e-274a-45a2-8977-4d29dc4a15a3 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.051227 Aug 18 17:13:23.587037 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 484/1014] 10.222.0.78 () {60 vars in 1343 bytes} [Thu Aug 18 17:13:23 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:23.668099 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:23.668643 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:23.671357 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=11 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:23.672062 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=87 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:23.677467 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:23.677985 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:23.678426 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:23.679122 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:23.679613 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:23.680040 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:23.705474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:13:24.061737 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-5980a191-8efa-4c5a-a866-bbdf3b99d31d tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 204 len: 0 microversion: 2.20 time: 0.397254 Aug 18 17:13:24.062332 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 531/1015] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Aug 18 17:13:23 2022] DELETE /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 18 17:13:24.071328 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:24.072008 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:24.078987 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:24.079504 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:24.079947 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:24.080643 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:24.081104 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:24.081604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:24.367352 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:24.375766 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:24.377329 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:24.378497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a8774660-0fd0-41a2-9561-14db316bcb28 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.311824 Aug 18 17:13:24.379106 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 485/1016] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:24 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:25.402419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:25.403150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:25.409723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:25.410201 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:25.410635 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:25.411333 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:25.411826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:25.412253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:25.547930 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:25.556981 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:25.558485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:25.560240 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9ae1c52e-68cb-4211-b55d-d69ca8413f36 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1723 microversion: 2.20 time: 0.161545 Aug 18 17:13:25.560240 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 532/1017] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:25 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:26.583764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:26.584505 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:26.591280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:26.591882 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:26.592387 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:26.593241 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:26.593647 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:26.594074 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:26.659586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:26.668357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:26.669854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1fa85bec641f4c2391af50d66339d9fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '697adc4a3b0f40ff85d6b415b6bbbefd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:26.671021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b43b4f73-163f-48e9-9075-fd8701da94d2 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 200 len: 1656 microversion: 2.20 time: 0.091475 Aug 18 17:13:26.671631 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 486/1018] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:26 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 1656 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 18 17:13:26.765179 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-e2c5e0ab-be5b-4b64-8453-56462723e963 req-0d2f93f8-81c9-4180-a8c6-88d702d2d883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5400d9b3-34f6-451c-bb5c-ae2b231dcc5b", "name": "network-vif-deleted", "tag": "6a4d4f56-49e2-4fd7-905b-4ed206d8d756"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:26.776622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-e2c5e0ab-be5b-4b64-8453-56462723e963 req-0d2f93f8-81c9-4180-a8c6-88d702d2d883 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:26.777105 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-e2c5e0ab-be5b-4b64-8453-56462723e963 req-0d2f93f8-81c9-4180-a8c6-88d702d2d883 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:26.777541 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-e2c5e0ab-be5b-4b64-8453-56462723e963 req-0d2f93f8-81c9-4180-a8c6-88d702d2d883 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:26.789841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-e2c5e0ab-be5b-4b64-8453-56462723e963 req-0d2f93f8-81c9-4180-a8c6-88d702d2d883 service nova] Creating event network-vif-deleted:6a4d4f56-49e2-4fd7-905b-4ed206d8d756 for instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b on hv-cinder-85367 Aug 18 17:13:26.794633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-e2c5e0ab-be5b-4b64-8453-56462723e963 req-0d2f93f8-81c9-4180-a8c6-88d702d2d883 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034108 Aug 18 17:13:26.795569 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 533/1019] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:13:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:27.694938 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:27.695655 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:27.702411 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:27.702900 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:27.703349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:27.704113 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:27.704567 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:27.704990 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:27.720352 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] HTTP exception thrown: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Request method failure captured: Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b HTTP/1.1 Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFaLcpNJBVDzjfR7XfrIVdHb-IYr4Au8vPBw8GSzWj9m60UknQqhkymKV4Sa_J6_nLyBG1mgVG0NtjqEm5aNhUmj5b8Wi0odYDE-HWXk-426CTGgYwmvXk-4ZAedfg_i1S5UqJA-vXIVbq0SU3mNfVBqKxnqf-AfopPvypB51YDGZc Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:13:27.721867 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_697adc4a3b0f40ff85d6b415b6bbbefd", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 1fa85bec641f4c2391af50d66339d9fe Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:27.723460 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '5400d9b3-34f6-451c-bb5c-ae2b231dcc5b'} Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:27.724680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:27.726084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:27.727983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Returning 404 to user: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:27.727983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f1488129-71cb-4672-a614-1bcbcc91e082 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 404 len: 111 microversion: 2.20 time: 0.033050 Aug 18 17:13:27.727983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 487/1020] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:27 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:13:27.733101 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a2b502b6-8a7d-43b5-a536-87b07ec74358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '.version_select at 0x7ff5b51a83a0>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:27.823748 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a2b502b6-8a7d-43b5-a536-87b07ec74358 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-585950943" status: 204 len: 0 microversion: 2.20 time: 0.093852 Aug 18 17:13:27.824612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 534/1021] 10.222.0.78 () {60 vars in 1259 bytes} [Thu Aug 18 17:13:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-585950943 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Aug 18 17:13:29.976708 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:29.977249 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:29.983577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:29.984062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:29.984500 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:29.985195 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:29.985652 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:29.986080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:29.999403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] HTTP exception thrown: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Request method failure captured: Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: DELETE /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b HTTP/1.1 Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFaLcpNJBVDzjfR7XfrIVdHb-IYr4Au8vPBw8GSzWj9m60UknQqhkymKV4Sa_J6_nLyBG1mgVG0NtjqEm5aNhUmj5b8Wi0odYDE-HWXk-426CTGgYwmvXk-4ZAedfg_i1S5UqJA-vXIVbq0SU3mNfVBqKxnqf-AfopPvypB51YDGZc Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:13:30.001014 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_697adc4a3b0f40ff85d6b415b6bbbefd", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 1fa85bec641f4c2391af50d66339d9fe Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.002759 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '5400d9b3-34f6-451c-bb5c-ae2b231dcc5b'} Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:30.004327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.005480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.011627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Returning 404 to user: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:30.011627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c38a9a9c-1010-4d39-b4ea-14390de8c8e6 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 404 len: 111 microversion: 2.20 time: 0.029622 Aug 18 17:13:30.011627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 488/1022] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Aug 18 17:13:29 2022] DELETE /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:13:30.013211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:30.013946 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:30.021665 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:30.022288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:30.022733 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:30.023621 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:30.024087 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:30.024512 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] HTTP exception thrown: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Request method failure captured: Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b HTTP/1.1 Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFaLcpNJBVDzjfR7XfrIVdHb-IYr4Au8vPBw8GSzWj9m60UknQqhkymKV4Sa_J6_nLyBG1mgVG0NtjqEm5aNhUmj5b8Wi0odYDE-HWXk-426CTGgYwmvXk-4ZAedfg_i1S5UqJA-vXIVbq0SU3mNfVBqKxnqf-AfopPvypB51YDGZc Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:13:30.040472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_697adc4a3b0f40ff85d6b415b6bbbefd", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fa85bec641f4c2391af50d66339d9fe Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.042274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '5400d9b3-34f6-451c-bb5c-ae2b231dcc5b'} Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:30.043526 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. Aug 18 17:13:30.045652 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:30.047067 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Returning 404 to user: Instance 5400d9b3-34f6-451c-bb5c-ae2b231dcc5b could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:30.047067 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-79d411b6-9e4c-4f1e-89cd-c8cde2464439 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b" status: 404 len: 111 microversion: 2.20 time: 0.033771 Aug 18 17:13:30.047067 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 535/1023] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:30 2022] GET /compute/v2.1/servers/5400d9b3-34f6-451c-bb5c-ae2b231dcc5b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:13:31.400538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:31.401101 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:31.407670 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.408206 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.408699 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.409385 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.409833 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.410257 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.424017 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] HTTP exception thrown: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Request method failure captured: Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: DELETE /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 HTTP/1.1 Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nFaLcpNJBVDzjfR7XfrIVdHb-IYr4Au8vPBw8GSzWj9m60UknQqhkymKV4Sa_J6_nLyBG1mgVG0NtjqEm5aNhUmj5b8Wi0odYDE-HWXk-426CTGgYwmvXk-4ZAedfg_i1S5UqJA-vXIVbq0SU3mNfVBqKxnqf-AfopPvypB51YDGZc Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:13:31.425586 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_697adc4a3b0f40ff85d6b415b6bbbefd", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 1fa85bec641f4c2391af50d66339d9fe Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.427027 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '68e481aa-bf5a-436b-baca-f5c8b88de401'} Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:31.427831 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.429034 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.430474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Returning 404 to user: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:31.430474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-44107e04-0cfa-4f46-940c-c60fd38f1204 tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "DELETE /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 404 len: 111 microversion: 2.20 time: 0.030361 Aug 18 17:13:31.430474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 489/1024] 10.222.0.78 () {60 vars in 1280 bytes} [Thu Aug 18 17:13:31 2022] DELETE /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:13:31.440579 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:31.442107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] [instance: 68e481aa-bf5a-436b-baca-f5c8b88de401] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:31.449230 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.449794 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.450303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.451098 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:31.451598 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:31.452094 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:31.466228 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] HTTP exception thrown: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Request method failure captured: Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 HTTP/1.1 Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nFaLcpNJBVDzjfR7XfrIVdHb-IYr4Au8vPBw8GSzWj9m60UknQqhkymKV4Sa_J6_nLyBG1mgVG0NtjqEm5aNhUmj5b8Wi0odYDE-HWXk-426CTGgYwmvXk-4ZAedfg_i1S5UqJA-vXIVbq0SU3mNfVBqKxnqf-AfopPvypB51YDGZc Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Openstack-Nova-Api-Version: 2.20 Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:13:31.467819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/697adc4a3b0f40ff85d6b415b6bbbefd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_697adc4a3b0f40ff85d6b415b6bbbefd", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 697adc4a3b0f40ff85d6b415b6bbbefd Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1408847575 Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: 1fa85bec641f4c2391af50d66339d9fe Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1408847575-project Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.469556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '68e481aa-bf5a-436b-baca-f5c8b88de401'} Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:13:31.470605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. Aug 18 17:13:31.472107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:13:31.473520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] Returning 404 to user: Instance 68e481aa-bf5a-436b-baca-f5c8b88de401 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:13:31.473520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d9134432-5647-421b-b807-b3ed3dfcd4cd tempest-AttachVolumeShelveTestJSON-1408847575 tempest-AttachVolumeShelveTestJSON-1408847575-project] 10.222.0.78 "GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401" status: 404 len: 111 microversion: 2.20 time: 0.032670 Aug 18 17:13:31.473520 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 536/1025] 10.222.0.78 () {60 vars in 1277 bytes} [Thu Aug 18 17:13:31 2022] GET /compute/v2.1/servers/68e481aa-bf5a-436b-baca-f5c8b88de401 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 18 17:13:39.519722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c3919e26-bc64-49cb-8310-d048322d8cb6 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b7483ca0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:39.573237 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c3919e26-bc64-49cb-8310-d048322d8cb6 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/a7fa7c6c-6245-4765-b6a4-804fca44b470" status: 200 len: 351 microversion: 2.1 time: 0.057404 Aug 18 17:13:39.573882 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 490/1026] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:13:39 2022] GET /compute/v2.1/os-volumes/a7fa7c6c-6245-4765-b6a4-804fca44b470 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:41.302541 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-059d17bf-3ad1-4898-a9c0-55fd2531e435 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4f9eb80>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:41.351071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-059d17bf-3ad1-4898-a9c0-55fd2531e435 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/edf4b615-8c44-418d-b56e-d65ef0bd247e" status: 200 len: 350 microversion: 2.1 time: 0.053005 Aug 18 17:13:41.351646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 537/1027] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:13:41 2022] GET /compute/v2.1/os-volumes/edf4b615-8c44-418d-b56e-d65ef0bd247e => generated 350 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:43.088295 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=12 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:43.089077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=24 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:43.093026 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-92ddf174-660a-41e9-b2c5-a983770a1d69 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4ce21f0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.142733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-92ddf174-660a-41e9-b2c5-a983770a1d69 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/6c06554f-cac7-4fce-8bce-bbfb77742c40" status: 200 len: 350 microversion: 2.1 time: 0.055699 Aug 18 17:13:43.143337 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 491/1028] 10.222.0.78 () {58 vars in 1245 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/os-volumes/6c06554f-cac7-4fce-8bce-bbfb77742c40 => generated 350 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:43.153259 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:43.154022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:13:43.158220 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bda6bf45-a08d-4a16-95b3-b82144371dd0 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4cdb940>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.245028 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bda6bf45-a08d-4a16-95b3-b82144371dd0 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.092455 Aug 18 17:13:43.245597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 538/1029] 10.222.0.78 () {58 vars in 1134 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:43.259845 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-7e7c3247-64b9-4e9b-9f2b-a1ad8b8bf00c tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4ca8af0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.346674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-7e7c3247-64b9-4e9b-9f2b-a1ad8b8bf00c tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.090888 Aug 18 17:13:43.347229 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 492/1030] 10.222.0.78 () {58 vars in 1149 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:13:43.360859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9bcadd0d-4d69-436f-aa00-3903de738712 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4ba3040>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.446328 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9bcadd0d-4d69-436f-aa00-3903de738712 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.089177 Aug 18 17:13:43.446589 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 539/1031] 10.222.0.78 () {58 vars in 1134 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:43.459873 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d6a8e1a2-6699-4c13-b16e-cfd038224c9c tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4c0a040>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.544427 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d6a8e1a2-6699-4c13-b16e-cfd038224c9c tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.088459 Aug 18 17:13:43.551177 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 493/1032] 10.222.0.78 () {58 vars in 1167 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:43.564490 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-780f3743-9cf8-42a9-9bec-1e1048eee504 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4e46ca0>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.649293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-780f3743-9cf8-42a9-9bec-1e1048eee504 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.089686 Aug 18 17:13:43.649869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 540/1033] 10.222.0.78 () {58 vars in 1170 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:43.664326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-6ca58a35-4773-4aaf-bab9-a5a18e964aaf tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4d0fee0>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.748182 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-6ca58a35-4773-4aaf-bab9-a5a18e964aaf tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.088535 Aug 18 17:13:43.748739 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 494/1034] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:43.766436 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f7c96abe-256d-42bb-830c-35e0aef2365f tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4e7fe50>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.852137 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f7c96abe-256d-42bb-830c-35e0aef2365f tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.090518 Aug 18 17:13:43.857199 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 541/1035] 10.222.0.78 () {58 vars in 1188 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:13:43.865883 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a60ca3e1-b470-40a2-a8ac-6511759d9256 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] Calling method '.version_select at 0x7ff5b4c0a160>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:43.949627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a60ca3e1-b470-40a2-a8ac-6511759d9256 tempest-VolumesTestJSON-1897396672 tempest-VolumesTestJSON-1897396672-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.087577 Aug 18 17:13:43.950319 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 495/1036] 10.222.0.78 () {58 vars in 1155 bytes} [Thu Aug 18 17:13:43 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:49.122362 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:49.122961 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:49.129795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:49.130364 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:49.130814 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:49.131555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:49.132295 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:49.132681 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:49.217249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.objects.instance [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lazy-loading 'services' on Instance uuid 08626bd0-6047-4258-a83d-efb24d789f0d {{(pid=121267) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:13:49.437895 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ae3e4915-fc37-4691-9cee-5ecc0f943899 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/os-volume_attachments/35868587-0ec1-4c16-aa70-f990983de9cc" status: 202 len: 0 microversion: 2.1 time: 0.319865 Aug 18 17:13:49.438850 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 542/1037] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:13:49 2022] DELETE /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/os-volume_attachments/35868587-0ec1-4c16-aa70-f990983de9cc => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:13:50.575727 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-737726bb-8501-40fd-8a15-290316b5c40d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:13:50.583537 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-737726bb-8501-40fd-8a15-290316b5c40d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:50.584037 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-737726bb-8501-40fd-8a15-290316b5c40d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:50.584478 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-737726bb-8501-40fd-8a15-290316b5c40d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:50.606879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-737726bb-8501-40fd-8a15-290316b5c40d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Going to try to stop instance {{(pid=121268) force_stop /opt/stack/nova/nova/compute/api.py:2752}} Aug 18 17:13:51.201112 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-737726bb-8501-40fd-8a15-290316b5c40d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/action" status: 202 len: 0 microversion: 2.1 time: 0.629846 Aug 18 17:13:51.201734 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 496/1038] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:13:50 2022] POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/action => generated 0 bytes in 631 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:13:51.210712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:51.212241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:51.220689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:51.221371 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:51.221900 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:51.222806 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:51.223515 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:51.223955 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:51.374834 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:51.385278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-58040290-f36c-49a8-a365-dd58f61f4d8e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1677 microversion: 2.1 time: 0.179124 Aug 18 17:13:51.386444 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 543/1039] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:51 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1677 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:52.407218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:52.408339 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:52.415600 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:52.416265 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:52.416666 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:52.417439 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:52.417945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:52.418406 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:52.560022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:52.568835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1a86894f-7f01-4b08-9303-18036db0b9d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1677 microversion: 2.1 time: 0.166372 Aug 18 17:13:52.569404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 497/1040] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:52 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1677 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:53.591091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:53.591739 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:53.598203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:53.598694 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:53.599132 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:53.599867 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:53.600330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:53.600762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:53.739869 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:53.747881 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d54906d6-509a-441d-af09-feed83656528 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1677 microversion: 2.1 time: 0.160614 Aug 18 17:13:53.748455 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 544/1041] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:53 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:54.770261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:54.770955 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:54.777577 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:54.778272 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:54.779173 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:54.779924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:54.780391 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:54.780834 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:54.916724 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:54.924395 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0fc2ed4c-0640-4422-9bb6-14bfc4e8bf4d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1677 microversion: 2.1 time: 0.158680 Aug 18 17:13:54.924950 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 498/1042] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:54 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:55.946488 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:55.947096 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:55.953554 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:55.956660 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:55.957055 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:55.957767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:55.958221 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:55.958641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:56.105196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:56.110805 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e8908bf7-1803-40b8-b0f8-aaa8c6a5793e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1677 microversion: 2.1 time: 0.168078 Aug 18 17:13:56.111394 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 545/1043] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:55 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1677 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:57.137913 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:57.138534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:57.144956 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:57.145447 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:57.145886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:57.146583 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:57.147041 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:57.147489 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:57.275945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:57.283766 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b7067a3a-148c-4b5c-a3f4-3af0457cc6d9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1677 microversion: 2.1 time: 0.149698 Aug 18 17:13:57.284322 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 499/1044] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:57 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:58.306040 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:58.306647 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:58.313024 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:58.313505 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:58.313933 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:58.314626 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:58.315075 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:58.315519 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:58.443069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:58.451182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1b372ff8-bcbe-4d45-9586-5980d74b2b2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1677 microversion: 2.1 time: 0.149024 Aug 18 17:13:58.451786 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 546/1045] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:58 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1677 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:13:59.472251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:13:59.473469 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:13:59.480597 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:59.481094 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:59.481540 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:59.482251 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:13:59.482713 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:13:59.483144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:13:59.619698 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:13:59.628318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8a0292c1-efd5-4c3d-b39d-03d8997a3903 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1677 microversion: 2.1 time: 0.160172 Aug 18 17:13:59.628887 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 500/1046] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:13:59 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:00.651428 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:00.652085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:00.658533 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:00.659056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:00.659483 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:00.660744 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:00.661206 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:00.661629 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:00.801913 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:00.810240 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4a4fd6e5-708e-4e4a-b3bf-592b9272126b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1677 microversion: 2.1 time: 0.162662 Aug 18 17:14:00.811979 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 547/1047] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:00 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:01.832156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:01.832808 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:01.839317 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:01.839839 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:01.840275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:01.840978 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:01.841432 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:01.841859 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:01.976149 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:01.984295 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e8ce9c69-0294-47b7-b3af-69f67d45a627 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1654 microversion: 2.1 time: 0.156998 Aug 18 17:14:01.984864 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 501/1048] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:01 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1654 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:02.011450 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-006a5887-a8b4-4e00-b034-a00fc840aa04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:02.018193 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-006a5887-a8b4-4e00-b034-a00fc840aa04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:02.018680 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-006a5887-a8b4-4e00-b034-a00fc840aa04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:02.019213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-006a5887-a8b4-4e00-b034-a00fc840aa04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:02.079022 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-006a5887-a8b4-4e00-b034-a00fc840aa04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Going to try to start instance {{(pid=121267) start /opt/stack/nova/nova/compute/api.py:2775}} Aug 18 17:14:02.331000 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-006a5887-a8b4-4e00-b034-a00fc840aa04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/action" status: 202 len: 0 microversion: 2.1 time: 0.323481 Aug 18 17:14:02.331623 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 548/1049] 10.222.0.78 () {60 vars in 1278 bytes} [Thu Aug 18 17:14:02 2022] POST /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/action => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:14:02.340254 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:02.340875 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:02.346814 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:02.347333 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:02.347796 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:02.348497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:02.348954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:02.349370 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:02.486504 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:02.495776 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-aee627d0-0add-4379-b71e-17ceffc523e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1663 microversion: 2.1 time: 0.159069 Aug 18 17:14:02.496359 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 502/1050] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:02 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1663 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:03.523127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:03.523127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:03.526052 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:03.526627 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:03.526962 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:03.527683 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:03.528133 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:03.528547 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:03.665108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:03.672923 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-09559324-3ad5-4999-bebe-0015d2ea628d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1663 microversion: 2.1 time: 0.158693 Aug 18 17:14:03.673484 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 549/1051] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:03 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:04.694825 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:04.695627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:04.701975 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:04.702665 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:04.703096 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:04.703822 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:04.704293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:04.704714 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:04.840391 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:04.848654 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-1340f005-8930-410e-beb1-0bf03038b437 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1667 microversion: 2.1 time: 0.158206 Aug 18 17:14:04.849228 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 503/1052] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:04 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1667 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:37.354514 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-cffbca24-edfb-4acd-854a-ab7b88b301b4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:37.356783 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-cffbca24-edfb-4acd-854a-ab7b88b301b4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:37.358941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=16 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:37.359624 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:37.364384 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cffbca24-edfb-4acd-854a-ab7b88b301b4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.364872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cffbca24-edfb-4acd-854a-ab7b88b301b4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.365311 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cffbca24-edfb-4acd-854a-ab7b88b301b4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.366051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cffbca24-edfb-4acd-854a-ab7b88b301b4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.366510 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cffbca24-edfb-4acd-854a-ab7b88b301b4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.367004 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-cffbca24-edfb-4acd-854a-ab7b88b301b4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.397423 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-cffbca24-edfb-4acd-854a-ab7b88b301b4 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047015 Aug 18 17:14:37.398998 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 550/1053] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:14:37 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:14:37.465966 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:37.466503 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:37.468544 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=16 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:37.469198 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:37.473850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.474340 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.474779 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.476089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.476553 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.476980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.502324 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:14:37.846024 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-31ea60f4-31b6-4d5d-be13-b9bdd2e36737 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 204 len: 0 microversion: 2.1 time: 0.383994 Aug 18 17:14:37.846619 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 504/1054] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:14:37 2022] DELETE /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:14:37.854715 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:37.855330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:37.861937 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.862424 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.862862 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.863590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:37.864049 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:37.864475 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:37.997779 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:38.005466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-dcc96e61-5b45-4702-a316-b3d28607d3e9 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1673 microversion: 2.1 time: 0.154536 Aug 18 17:14:38.006038 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 551/1055] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:37 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1673 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:39.028674 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:39.029396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:39.035958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:39.036411 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:39.036870 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:39.038310 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:39.038843 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:39.039259 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:39.171698 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:39.179547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-315892a7-773f-4206-9252-2c057ad4cd91 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1673 microversion: 2.1 time: 0.155273 Aug 18 17:14:39.180107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 505/1056] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:39 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:40.201043 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:40.201935 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:40.209075 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:40.210262 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:40.210798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:40.211733 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:40.212414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:40.213051 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:40.364632 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:40.373785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a5edca65-3ca2-4381-83a9-fd416fed989e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1673 microversion: 2.1 time: 0.176946 Aug 18 17:14:40.374381 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 552/1057] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:40 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1673 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:41.094350 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-e431fb87-b83b-424a-9c9b-969c41082dcb req-f87b3e74-b5e1-421e-8bc4-d7feffafc0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08626bd0-6047-4258-a83d-efb24d789f0d", "name": "network-vif-deleted", "tag": "73b593a6-2fae-4e85-9374-fafccac8c7ac"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:41.101607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-e431fb87-b83b-424a-9c9b-969c41082dcb req-f87b3e74-b5e1-421e-8bc4-d7feffafc0f0 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:41.102088 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-e431fb87-b83b-424a-9c9b-969c41082dcb req-f87b3e74-b5e1-421e-8bc4-d7feffafc0f0 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:41.102775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-e431fb87-b83b-424a-9c9b-969c41082dcb req-f87b3e74-b5e1-421e-8bc4-d7feffafc0f0 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:41.113910 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-e431fb87-b83b-424a-9c9b-969c41082dcb req-f87b3e74-b5e1-421e-8bc4-d7feffafc0f0 service nova] Creating event network-vif-deleted:73b593a6-2fae-4e85-9374-fafccac8c7ac for instance 08626bd0-6047-4258-a83d-efb24d789f0d on hv-cinder-85367 Aug 18 17:14:41.119637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-e431fb87-b83b-424a-9c9b-969c41082dcb req-f87b3e74-b5e1-421e-8bc4-d7feffafc0f0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031792 Aug 18 17:14:41.120165 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 506/1058] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:14:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:14:41.396634 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:41.397414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:41.404091 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:41.404745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:41.405632 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:41.406615 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:41.407196 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:41.407937 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:41.502369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:41.532466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-830efec0-7b1f-4dab-9c77-f84e2bcd2605 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1322 microversion: 2.1 time: 0.140584 Aug 18 17:14:41.547485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 553/1059] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:41 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1322 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:42.556938 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:42.557761 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:42.566708 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:42.567207 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:42.567685 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:42.568437 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:42.569496 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:42.569920 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:42.602056 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:42.602537 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:42.602972 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:42.603418 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lazy-loading 'fault' on Instance uuid 08626bd0-6047-4258-a83d-efb24d789f0d {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:14:42.648742 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:42.656508 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-484d2b28-34ba-4dfc-87a9-424b2a69b459 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 200 len: 1327 microversion: 2.1 time: 0.105922 Aug 18 17:14:42.657094 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 507/1060] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:42 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:43.685478 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:43.686258 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:43.694763 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.695224 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.695820 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.696488 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:43.696941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:43.697497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:43.715081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] HTTP exception thrown: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Request method failure captured: Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d HTTP/1.1 Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nK4cUIAls61t07tY5K7IxoJcGbFydnUxzKH4LKHxuS0Ux5Q6hCoO8yYTSqMOHkinJjlcb3v6odSh-SZnuCZPskiD-77vlVbjx7jHQ0r1Q7MEz8rV4qI0ghEe-aOnWnbBMXDf3SPzeyiwjB_iqP1A0cdaMEbMhCpiQyG1aSMdCpFPkw Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:14:43.716795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44e1819d40894e26bfbe20d58589823f", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: d909457b883345c982916c842926836d Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:14:43.718523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '08626bd0-6047-4258-a83d-efb24d789f0d'} Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:14:43.719743 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:14:43.721316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:14:43.723969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Returning 404 to user: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:14:43.724864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-736f4393-4951-4c84-956a-6cb5f95b1691 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 404 len: 111 microversion: 2.1 time: 0.044019 Aug 18 17:14:43.726482 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 554/1061] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:43 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:14:43.734011 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2ed2b314-92ca-466e-b00a-6b6f9f320d73 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '.version_select at 0x7ff5b4ca8c10>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:44.238211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2ed2b314-92ca-466e-b00a-6b6f9f320d73 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003315310" status: 202 len: 0 microversion: 2.1 time: 0.508103 Aug 18 17:14:44.238797 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 508/1062] 10.222.0.78 () {58 vars in 1221 bytes} [Thu Aug 18 17:14:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2003315310 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:14:45.171527 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1aae346d-cccf-4bbc-a68e-763e7d7aebaf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'create', calling method: .version_select at 0x7ff5b4e54dc0>, body: {"keypair": {"name": "tempest-keypair-788467178", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFdUIrfh1CMPydy+Epg+o/2s0SfWZj7Xq/RaE3XMZ8BA51saJxcZtQcbjuOXX8rMcs0RMEZKwBuOFJj8D1PkB6bAqZxiTGOsauieGscheHTlNmCPPyg7Ehpd6PnLG2Plqg=="}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:45.188639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-1aae346d-cccf-4bbc-a68e-763e7d7aebaf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Getting quotas for project 44e1819d40894e26bfbe20d58589823f. Resources: {'key_pairs'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:14:45.207824 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-1aae346d-cccf-4bbc-a68e-763e7d7aebaf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Getting quotas for user d909457b883345c982916c842926836d and project 44e1819d40894e26bfbe20d58589823f. Resources: {'key_pairs'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:14:45.375792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1aae346d-cccf-4bbc-a68e-763e7d7aebaf tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.208230 Aug 18 17:14:45.379752 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 555/1063] 10.222.0.78 () {60 vars in 1159 bytes} [Thu Aug 18 17:14:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:14:48.153592 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-51034823", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e79ee218-b8f4-4366-b86f-915853fc6747"}], "security_groups": [{"name": "tempest-securitygroup--587434129"}], "key_name": "tempest-keypair-788467178", "user_data": "}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:48.258195 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] validate_networks() for [('e79ee218-b8f4-4366-b86f-915853fc6747', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:14:48.648780 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:14:48.649202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:14:48.649680 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:14:48.650084 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:14:48.650490 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:14:48.659744 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:48.660270 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:48.660757 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:48.661480 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:48.661933 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:48.662357 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:48.680438 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Getting quotas for project 44e1819d40894e26bfbe20d58589823f. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:14:48.684551 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Getting quotas for user d909457b883345c982916c842926836d and project 44e1819d40894e26bfbe20d58589823f. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:14:48.696094 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:14:48.698378 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:14:48.989984 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [92b124f9-842c-4bd4-9c04-c8b9d1431f15] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 17:14:49.998127 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO oslo.messaging._drivers.impl_rabbit [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [92b124f9-842c-4bd4-9c04-c8b9d1431f15] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 51830. Aug 18 17:14:50.001767 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d138cfc8-c88a-4817-84cb-565152d671f3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.853281 Aug 18 17:14:50.002405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 509/1064] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:14:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1855 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:14:50.013546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-edd04082-2687-4e8c-b96e-9da6c5a4e581 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:50.014207 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-edd04082-2687-4e8c-b96e-9da6c5a4e581 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:50.067766 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-edd04082-2687-4e8c-b96e-9da6c5a4e581 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:50.074764 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-edd04082-2687-4e8c-b96e-9da6c5a4e581 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1235 microversion: 2.1 time: 0.065146 Aug 18 17:14:50.075338 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 556/1065] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:50 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1235 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:14:51.096732 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-673085d8-ca1f-4fc4-903b-a6a84fb56a6c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:51.098001 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-673085d8-ca1f-4fc4-903b-a6a84fb56a6c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:51.165072 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-673085d8-ca1f-4fc4-903b-a6a84fb56a6c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:51.172267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-673085d8-ca1f-4fc4-903b-a6a84fb56a6c tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1235 microversion: 2.1 time: 0.080699 Aug 18 17:14:51.173015 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 510/1066] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:51 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1235 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:52.193215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-acdd95f3-d0a6-492c-b368-5ceca75db034 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:52.193830 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-acdd95f3-d0a6-492c-b368-5ceca75db034 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:52.255497 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-acdd95f3-d0a6-492c-b368-5ceca75db034 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:52.268623 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-acdd95f3-d0a6-492c-b368-5ceca75db034 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1235 microversion: 2.1 time: 0.074960 Aug 18 17:14:52.268623 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 557/1067] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:52 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1235 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:53.285052 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-08499ef5-bb68-40cc-a0f3-9637a097748e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:53.285644 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-08499ef5-bb68-40cc-a0f3-9637a097748e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:53.338386 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-08499ef5-bb68-40cc-a0f3-9637a097748e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:53.345929 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-08499ef5-bb68-40cc-a0f3-9637a097748e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1235 microversion: 2.1 time: 0.064856 Aug 18 17:14:53.346821 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 511/1068] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:53 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1235 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:54.366940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:54.367510 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:54.369853 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=26 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:54.374769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:54.375264 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:54.380023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:54.380023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:54.380023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:54.380023 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:54.439913 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:54.448058 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-46dfe1be-fc74-44b2-981f-fe664f6f42f2 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1239 microversion: 2.1 time: 0.085576 Aug 18 17:14:54.448634 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 558/1069] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:54 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1239 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:55.481157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:55.481790 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:55.488871 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:55.489380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:55.489825 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:55.490526 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:55.491522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:55.491954 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:55.560942 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:55.569253 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8f495dbc-d53e-4176-bdfc-b065fb571a2a tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1239 microversion: 2.1 time: 0.091409 Aug 18 17:14:55.569451 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 512/1070] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:55 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1239 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:56.590619 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:56.591385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:56.602025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:56.602521 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:56.604897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:56.604897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:56.604897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:56.604897 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:56.681474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:56.689902 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4ee594c9-5194-4218-a906-b801788a70da tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1295 microversion: 2.1 time: 0.105128 Aug 18 17:14:56.690669 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 559/1071] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:56 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:57.710723 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:57.711989 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:57.718400 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:57.718883 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:57.719315 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:57.720125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:57.720588 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:57.721002 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:57.966038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:57.966038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-12325bca-2a2b-40fc-9205-7f70168e7052 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1360 microversion: 2.1 time: 0.183048 Aug 18 17:14:57.966038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 513/1072] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:57 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1360 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:14:58.319314 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-19ff9e40-9dac-4288-86a3-11823bb4eef8 req-db7553c4-b812-4a3b-b995-97063a63753c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585ef3ab-09d6-4564-8ddb-669ac58ed47a", "tag": "b60c8ba3-c3f4-49f7-96ff-a5a0b979e4d7"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:14:58.329212 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-19ff9e40-9dac-4288-86a3-11823bb4eef8 req-db7553c4-b812-4a3b-b995-97063a63753c service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:58.329700 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-19ff9e40-9dac-4288-86a3-11823bb4eef8 req-db7553c4-b812-4a3b-b995-97063a63753c service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:58.330134 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-19ff9e40-9dac-4288-86a3-11823bb4eef8 req-db7553c4-b812-4a3b-b995-97063a63753c service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:58.348714 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-19ff9e40-9dac-4288-86a3-11823bb4eef8 req-db7553c4-b812-4a3b-b995-97063a63753c service nova] Creating event network-changed:b60c8ba3-c3f4-49f7-96ff-a5a0b979e4d7 for instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a on hv-cinder-85367 Aug 18 17:14:58.354246 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-19ff9e40-9dac-4288-86a3-11823bb4eef8 req-db7553c4-b812-4a3b-b995-97063a63753c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038591 Aug 18 17:14:58.354852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 560/1073] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:14:58.911630 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:14:58.912263 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:14:58.914861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:14:58.920603 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:58.921104 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:58.921544 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:58.922245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:14:58.922702 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:14:58.923214 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:14:59.133297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:14:59.141721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4a1042cb-3a64-4f12-853b-de7128601e07 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1360 microversion: 2.1 time: 0.234129 Aug 18 17:14:59.142314 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 514/1074] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:14:58 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1360 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:00.164301 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:00.165007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:00.171187 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:00.172297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:00.172297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:00.172866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:00.173325 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:00.173746 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:00.303471 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:00.311476 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-51bfc52c-5170-49b8-9997-a2fa9bbcfef0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1360 microversion: 2.1 time: 0.151788 Aug 18 17:15:00.311925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 561/1075] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:00 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:01.332667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:01.333285 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:01.340411 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:01.346592 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:01.346592 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:01.346592 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:01.346592 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:01.347053 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:01.479825 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:01.487834 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-98ad435f-ac48-42fa-acb2-47d1fb8deaeb tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1360 microversion: 2.1 time: 0.159389 Aug 18 17:15:01.488419 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 515/1076] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:01 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1360 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:02.509993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:02.510662 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:02.513108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=8 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:02.518521 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:02.525420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:02.525420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:02.525420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:02.525420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:02.525860 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:02.661107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:02.667401 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e2a26e88-f6d4-47c8-86df-3290705fe2e8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1360 microversion: 2.1 time: 0.162373 Aug 18 17:15:02.668007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 562/1077] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:02 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1360 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:03.540231 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-ea0f22ed-005d-45d1-be9b-58a5088a4098 req-3e9bbc23-1e33-405b-b0ab-3bdd3e38eafc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585ef3ab-09d6-4564-8ddb-669ac58ed47a", "name": "network-vif-plugged", "status": "completed", "tag": "b60c8ba3-c3f4-49f7-96ff-a5a0b979e4d7"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:03.545599 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=10 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:03.551531 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ea0f22ed-005d-45d1-be9b-58a5088a4098 req-3e9bbc23-1e33-405b-b0ab-3bdd3e38eafc service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.552092 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ea0f22ed-005d-45d1-be9b-58a5088a4098 req-3e9bbc23-1e33-405b-b0ab-3bdd3e38eafc service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.552616 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-ea0f22ed-005d-45d1-be9b-58a5088a4098 req-3e9bbc23-1e33-405b-b0ab-3bdd3e38eafc service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.565232 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-ea0f22ed-005d-45d1-be9b-58a5088a4098 req-3e9bbc23-1e33-405b-b0ab-3bdd3e38eafc service nova] Creating event network-vif-plugged:b60c8ba3-c3f4-49f7-96ff-a5a0b979e4d7 for instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a on hv-cinder-85367 Aug 18 17:15:03.570962 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-ea0f22ed-005d-45d1-be9b-58a5088a4098 req-3e9bbc23-1e33-405b-b0ab-3bdd3e38eafc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034312 Aug 18 17:15:03.571521 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 516/1078] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:15:03.688140 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:03.688762 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:03.695499 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.703247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.703247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.703247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:03.703247 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:03.703699 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:03.837235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:03.844786 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-85153526-24bc-4d3c-b2ca-34833ae0dedc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1360 microversion: 2.1 time: 0.160680 Aug 18 17:15:03.845355 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 563/1079] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:03 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:04.866338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:04.867038 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:04.873632 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:04.874112 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:04.874545 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:04.875235 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:04.875722 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:04.876148 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:05.019691 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:05.033611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a329847b-ae67-48b9-a4a4-82f19027f93b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1360 microversion: 2.1 time: 0.167619 Aug 18 17:15:05.033611 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 517/1080] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:04 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1360 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:06.049054 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:06.049606 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:06.056692 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:06.057183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:06.057627 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:06.058468 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:06.058945 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:06.059374 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:06.199044 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:06.206875 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1db156b7-cccf-495f-911b-a1ee567f56c3 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1545 microversion: 2.1 time: 0.161945 Aug 18 17:15:06.207466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 564/1081] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:06 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1545 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:06.227724 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-87650c29-a82f-42eb-a1b3-6a71a75fe07f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:06.228273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-87650c29-a82f-42eb-a1b3-6a71a75fe07f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:06.234692 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-87650c29-a82f-42eb-a1b3-6a71a75fe07f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:06.235182 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-87650c29-a82f-42eb-a1b3-6a71a75fe07f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:06.235679 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-87650c29-a82f-42eb-a1b3-6a71a75fe07f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:06.236438 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-87650c29-a82f-42eb-a1b3-6a71a75fe07f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:06.236891 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-87650c29-a82f-42eb-a1b3-6a71a75fe07f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:06.237352 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-87650c29-a82f-42eb-a1b3-6a71a75fe07f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:06.320236 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-87650c29-a82f-42eb-a1b3-6a71a75fe07f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096541 Aug 18 17:15:06.320825 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 518/1082] 10.222.0.78 () {58 vars in 1275 bytes} [Thu Aug 18 17:15:06 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:07.506826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-ec905176-0394-4e21-9603-2dab419472e6 req-e358684a-3774-43f6-bd58-a75321086ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "585ef3ab-09d6-4564-8ddb-669ac58ed47a", "tag": "b60c8ba3-c3f4-49f7-96ff-a5a0b979e4d7"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:07.512058 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:07.517756 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-ec905176-0394-4e21-9603-2dab419472e6 req-e358684a-3774-43f6-bd58-a75321086ab7 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:07.518238 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-ec905176-0394-4e21-9603-2dab419472e6 req-e358684a-3774-43f6-bd58-a75321086ab7 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:07.518666 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-ec905176-0394-4e21-9603-2dab419472e6 req-e358684a-3774-43f6-bd58-a75321086ab7 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:07.530215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-ec905176-0394-4e21-9603-2dab419472e6 req-e358684a-3774-43f6-bd58-a75321086ab7 service nova] Creating event network-changed:b60c8ba3-c3f4-49f7-96ff-a5a0b979e4d7 for instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a on hv-cinder-85367 Aug 18 17:15:07.535451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-ec905176-0394-4e21-9603-2dab419472e6 req-e358684a-3774-43f6-bd58-a75321086ab7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033034 Aug 18 17:15:07.539901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 565/1083] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:07.560474 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:07.561559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:07.567817 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:07.569580 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:07.570261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:07.570917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:07.571915 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:07.572538 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:07.573125 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:07.615278 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:15:07.648214 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:07.994072 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c4193d58-86af-45d1-877a-92ba12155467 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 204 len: 0 microversion: 2.1 time: 0.437612 Aug 18 17:15:07.998469 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 519/1084] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:15:07 2022] DELETE /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 0 bytes in 440 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:15:08.008605 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:08.009553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:08.019636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:08.020917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:08.022257 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:08.023154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:08.024009 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:08.024624 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:08.203035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:08.214894 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-7372f55a-4c4d-4f09-b600-1e9616cacb56 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1578 microversion: 2.1 time: 0.214620 Aug 18 17:15:08.216581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 566/1085] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:07 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1578 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:09.238992 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:09.239764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:09.247372 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:09.248275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:09.248484 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:09.249098 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:09.249582 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:09.250013 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:09.662082 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:09.677436 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-24a22712-cb9d-4479-bab4-2d672cfd4f61 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1578 microversion: 2.1 time: 0.443285 Aug 18 17:15:09.678666 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 520/1086] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:09 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1578 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:10.616609 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-81ad959c-2bc7-49cb-9ce9-a7aadfff8371 req-9a378734-fb54-41c6-9fe1-0c523d682419 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7434d418-5586-4ce3-a420-21925506657c", "name": "network-vif-deleted", "tag": "32c22de7-72ea-42f2-9fbf-c5873ac6f9a8"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:10.626077 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-81ad959c-2bc7-49cb-9ce9-a7aadfff8371 req-9a378734-fb54-41c6-9fe1-0c523d682419 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:10.626556 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-81ad959c-2bc7-49cb-9ce9-a7aadfff8371 req-9a378734-fb54-41c6-9fe1-0c523d682419 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:10.626976 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-81ad959c-2bc7-49cb-9ce9-a7aadfff8371 req-9a378734-fb54-41c6-9fe1-0c523d682419 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:10.646160 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-81ad959c-2bc7-49cb-9ce9-a7aadfff8371 req-9a378734-fb54-41c6-9fe1-0c523d682419 service nova] Creating event network-vif-deleted:32c22de7-72ea-42f2-9fbf-c5873ac6f9a8 for instance 7434d418-5586-4ce3-a420-21925506657c on hv-cinder-85367 Aug 18 17:15:10.647213 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-81ad959c-2bc7-49cb-9ce9-a7aadfff8371 req-9a378734-fb54-41c6-9fe1-0c523d682419 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035296 Aug 18 17:15:10.648111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 567/1087] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:10.706326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:10.706992 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:10.714828 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:10.715331 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:10.716437 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:10.717548 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:10.718473 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:10.719215 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:10.822426 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1238878486", "imageRef": "85cc048b-a41b-479f-b996-cd115b5ac70e", "flavorRef": "452"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:10.836573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:10.846622 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-262deaf0-c4f0-40b7-b715-dc824069eb99 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1510 microversion: 2.1 time: 0.144143 Aug 18 17:15:10.860396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 521/1088] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:10 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1510 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:10.887297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.network.neutron [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] validate_networks() for None {{(pid=121267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:15:11.194969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Flavor limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:15:11.195391 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Image limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:15:11.195886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Flavor pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:15:11.196288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Image pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:15:11.196883 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:15:11.205989 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:11.206471 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:11.206893 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:11.207645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:11.208259 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:11.208686 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:11.226790 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Getting quotas for project 692bb1c3de754fd98526bc68fda47c91. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:15:11.230861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Getting quotas for user 049226c3e32f488e90e1520976ae1fed and project 692bb1c3de754fd98526bc68fda47c91. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:15:11.242692 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Going to run 1 instances... {{(pid=121267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:15:11.245156 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='85cc048b-a41b-479f-b996-cd115b5ac70e',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:15:11.462265 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR oslo.messaging._drivers.impl_rabbit [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [bee05387-14e2-4584-9756-2e3af1358f7b] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 18 17:15:11.868856 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:11.869607 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:11.877295 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:11.877789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:11.878496 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:11.879217 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:11.879728 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:11.880157 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:11.919797 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:11.920211 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:11.920664 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:11.921101 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lazy-loading 'fault' on Instance uuid 7434d418-5586-4ce3-a420-21925506657c {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:15:11.962583 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:11.970397 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3f0e9640-711c-4e4a-9d30-e3a0de0e1dfa tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 200 len: 1230 microversion: 2.1 time: 0.106168 Aug 18 17:15:11.971042 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 522/1089] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:11 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 1230 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:12.469985 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO oslo.messaging._drivers.impl_rabbit [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [bee05387-14e2-4584-9756-2e3af1358f7b] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 52110. Aug 18 17:15:12.473779 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-d51ad0ff-298d-4540-9347-9ad41874a0b5 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.657678 Aug 18 17:15:12.475034 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 568/1090] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:15:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:15:12.485678 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0d3f2e55-701f-4e95-b38c-08f46bb298f9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:12.486293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0d3f2e55-701f-4e95-b38c-08f46bb298f9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:12.540844 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0d3f2e55-701f-4e95-b38c-08f46bb298f9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:12.547760 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0d3f2e55-701f-4e95-b38c-08f46bb298f9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1215 microversion: 2.1 time: 0.065875 Aug 18 17:15:12.553099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 523/1091] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:12 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:12.999198 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:12.999840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:13.007923 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:13.008409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:13.008842 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:13.009539 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:13.009997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:13.010411 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:13.029261 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] HTTP exception thrown: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Request method failure captured: Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c HTTP/1.1 Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nLjOJLBWBLqDcZGYCRgONufTBXc_RgELt6BLG3sFR9zduDM0ui2BUEHN3jOj5kHSVNNCsaZ4Grp1YXKhY0pb_XKCA-HxZkPjVQ8ecOhMRPtcrrooYOBvh1iMgHwKoRiJGOSZsAvfBJkhEx4zDTNGap8erGMW1ZClzm1dQNLEbkL1QY Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:15:13.030840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c5e8eba08dfc4946becd6dba63f94eec", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-TestVolumeBootPattern-77034262 Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: f9d0f858ee07466a90d9c1ecf2c18c19 Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:15:13.033388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '7434d418-5586-4ce3-a420-21925506657c'} Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:15:13.035248 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:15:13.038116 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:15:13.040636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Returning 404 to user: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:15:13.040636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-287be042-3d58-49c8-a20f-e7683d4233e6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 404 len: 111 microversion: 2.1 time: 0.042193 Aug 18 17:15:13.040636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 569/1092] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:12 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:15:13.134223 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-849971840", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-513148516", "security_groups": [{"name": "tempest-secgroup-smoke-1612543765"}], "block_device_mapping_v2": [{"uuid": "da67211e-440f-4457-bfe2-92a5b7fa11e3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "744636b7-76bc-439f-9116-8e1ee85b3624"}]}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:13.250764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.network.neutron [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] validate_networks() for [('744636b7-76bc-439f-9116-8e1ee85b3624', None, None, None, None, None)] {{(pid=121268) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:15:13.571898 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-125a2993-3c69-4bcd-9d0a-a7fac99e4ab2 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:13.572682 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-125a2993-3c69-4bcd-9d0a-a7fac99e4ab2 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:13.631567 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-125a2993-3c69-4bcd-9d0a-a7fac99e4ab2 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:13.638945 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-125a2993-3c69-4bcd-9d0a-a7fac99e4ab2 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1215 microversion: 2.1 time: 0.072079 Aug 18 17:15:13.639750 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 570/1093] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:13 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1215 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:13.653093 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Flavor limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:15:13.653560 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Image limits 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:15:13.654109 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Flavor pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:15:13.654521 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Image pref 0:0:0 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:15:13.654934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.virt.hardware [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121268) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:15:13.664604 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:13.665093 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:13.665534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:13.666252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:13.666713 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:13.667135 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:13.684308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Getting quotas for project c5e8eba08dfc4946becd6dba63f94eec. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:15:13.688268 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.quota [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Getting quotas for user f9d0f858ee07466a90d9c1ecf2c18c19 and project c5e8eba08dfc4946becd6dba63f94eec. Resources: {'instances', 'ram', 'cores'} {{(pid=121268) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:15:13.747271 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Going to run 1 instances... {{(pid=121268) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:15:13.749434 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da67211e-440f-4457-bfe2-92a5b7fa11e3',volume_size=None,volume_type=None)] {{(pid=121268) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:15:14.455353 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-59971b4c-8b2f-4dc2-8dcf-3636bc993db6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.326167 Aug 18 17:15:14.456286 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 524/1094] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:15:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1328 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:15:14.466954 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-b8990465-4ece-4cbc-acef-87f005359e2d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:14.467597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-b8990465-4ece-4cbc-acef-87f005359e2d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:14.523760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-b8990465-4ece-4cbc-acef-87f005359e2d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:14.530621 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-b8990465-4ece-4cbc-acef-87f005359e2d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1093 microversion: 2.1 time: 0.067693 Aug 18 17:15:14.531186 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 571/1095] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:14 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:14.659325 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-54ec9b13-dfd0-4ccd-9d7d-50b3a0d59d2d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:14.660030 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-54ec9b13-dfd0-4ccd-9d7d-50b3a0d59d2d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:14.712808 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-54ec9b13-dfd0-4ccd-9d7d-50b3a0d59d2d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:14.719918 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-54ec9b13-dfd0-4ccd-9d7d-50b3a0d59d2d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1215 microversion: 2.1 time: 0.064378 Aug 18 17:15:14.720497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 525/1096] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:14 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:15.552143 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:15.553315 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:15.559993 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:15.560485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:15.560930 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:15.561639 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:15.562100 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:15.562529 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:15.625647 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:15.639880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-78b34dad-d710-40d0-af24-519b9de4aaaf tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1143 microversion: 2.1 time: 0.091458 Aug 18 17:15:15.640489 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 572/1097] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:15 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1143 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:15.741432 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0a94f11f-fb50-4d9f-af01-db0688c5b7a8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:15.742235 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0a94f11f-fb50-4d9f-af01-db0688c5b7a8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:15.803651 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-0a94f11f-fb50-4d9f-af01-db0688c5b7a8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:15.810960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0a94f11f-fb50-4d9f-af01-db0688c5b7a8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1215 microversion: 2.1 time: 0.073931 Aug 18 17:15:15.814129 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 526/1098] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:15 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1215 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:16.660901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:16.661522 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:16.668522 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:16.669004 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:16.669438 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:16.670250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:16.670745 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:16.671182 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:16.760553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:16.760553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3f36c951-3cdd-48fb-b86b-7cd5012b5186 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1191 microversion: 2.1 time: 0.085130 Aug 18 17:15:16.760553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 573/1099] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:16 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:16.831719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-2f565a85-e0e2-4e16-b078-91cc3fb26a46 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:16.832338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-2f565a85-e0e2-4e16-b078-91cc3fb26a46 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:16.884936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-2f565a85-e0e2-4e16-b078-91cc3fb26a46 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:16.891926 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-2f565a85-e0e2-4e16-b078-91cc3fb26a46 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1215 microversion: 2.1 time: 0.064106 Aug 18 17:15:16.892579 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 527/1100] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:16 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1215 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:17.767082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:17.767641 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:17.774136 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:17.774613 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:17.775042 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:17.775768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:17.776219 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:17.776636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:17.840808 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:17.848940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0948d120-c761-4658-b761-d11a5534fdab tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1209 microversion: 2.1 time: 0.088651 Aug 18 17:15:17.856549 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 574/1101] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:17 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:17.916333 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:17.917584 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:17.924565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:17.925064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:17.925535 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:17.926256 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:17.926703 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:17.927850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:17.999154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:18.008160 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-135a80eb-aa3e-48fd-ad8e-5a515287b31e tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1219 microversion: 2.1 time: 0.099268 Aug 18 17:15:18.009099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 528/1102] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:17 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:18.870458 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:18.871103 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:18.877841 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:18.878334 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:18.878773 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:18.879554 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:18.880511 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:18.880886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:18.969410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-b167cdc4-1966-40ca-ad46-59e6d1cee7e5 req-03099356-25ee-4851-bb13-8e6c53f2c731 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe99c95-ce5b-467a-92d4-15b02ac57d02", "tag": "ae35b8e6-3767-4d67-8189-4241efe3de81"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:18.980983 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b167cdc4-1966-40ca-ad46-59e6d1cee7e5 req-03099356-25ee-4851-bb13-8e6c53f2c731 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:18.981473 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b167cdc4-1966-40ca-ad46-59e6d1cee7e5 req-03099356-25ee-4851-bb13-8e6c53f2c731 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:18.981907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-b167cdc4-1966-40ca-ad46-59e6d1cee7e5 req-03099356-25ee-4851-bb13-8e6c53f2c731 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:18.997135 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-b167cdc4-1966-40ca-ad46-59e6d1cee7e5 req-03099356-25ee-4851-bb13-8e6c53f2c731 service nova] Creating event network-changed:ae35b8e6-3767-4d67-8189-4241efe3de81 for instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 on hv-cinder-85367 Aug 18 17:15:19.002408 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-b167cdc4-1966-40ca-ad46-59e6d1cee7e5 req-03099356-25ee-4851-bb13-8e6c53f2c731 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037025 Aug 18 17:15:19.004033 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 529/1103] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:15:19.020016 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:19.029164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:19.030984 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:19.035516 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-535dbf9f-dacf-489a-b3e4-28e936057b16 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1277 microversion: 2.1 time: 0.169555 Aug 18 17:15:19.038159 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:19.038392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 575/1104] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:18 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1277 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:19.039107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:19.039583 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:19.040298 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:19.040755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:19.041213 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:19.127392 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:19.135338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-70bdddb9-d4a4-465f-b676-551c19ac2d7d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1267 microversion: 2.1 time: 0.110310 Aug 18 17:15:19.135981 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 530/1105] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:19 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1267 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:20.076813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:20.076813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:20.076813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:20.076813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:20.077594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:20.077594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:20.077594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:20.077594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:20.157835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:20.158384 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:20.164705 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:20.165193 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:20.165630 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:20.166336 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:20.166797 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:20.167218 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:20.235126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:20.247989 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2cdfd33a-d353-4ef0-8693-b069e784eba8 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.192825 Aug 18 17:15:20.249043 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 576/1106] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:20 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:20.249153 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:20.257771 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5f49fa5f-bf32-4ef9-923b-0fa666b0ace7 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1275 microversion: 2.1 time: 0.104049 Aug 18 17:15:20.258351 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 531/1107] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:20 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1275 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:21.270495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:21.275496 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:21.275879 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:21.279308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:21.279857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:21.280128 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:21.280274 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:21.280994 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:21.281767 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:21.282289 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:21.282776 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:21.287406 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:21.288417 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:21.288569 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:21.289361 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:21.289895 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:21.290395 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:21.444595 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:21.452634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c1b56f52-2593-42ee-830c-7b1481af3ac8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1315 microversion: 2.1 time: 0.177430 Aug 18 17:15:21.453217 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 532/1108] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:21 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:21.534404 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:21.542658 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-06816470-f617-4be8-8e07-4d4d71ea03ec tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.276227 Aug 18 17:15:21.547794 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 577/1109] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:21 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:22.478422 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:22.478422 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:22.482135 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:22.482706 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:22.483219 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:22.484069 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:22.484717 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:22.485089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:22.487925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-bbf1ee68-5e69-4e7f-bdd8-89d6119e4da1 req-bcd5c335-c68d-4c13-a189-a63da5031530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc297fd-3aa2-4bc4-b6e4-0be967fe7838", "tag": "d0fdc6da-2556-482e-ad5d-5bef103df0d3"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:22.499350 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-bbf1ee68-5e69-4e7f-bdd8-89d6119e4da1 req-bcd5c335-c68d-4c13-a189-a63da5031530 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:22.499878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-bbf1ee68-5e69-4e7f-bdd8-89d6119e4da1 req-bcd5c335-c68d-4c13-a189-a63da5031530 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:22.500312 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-bbf1ee68-5e69-4e7f-bdd8-89d6119e4da1 req-bcd5c335-c68d-4c13-a189-a63da5031530 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:22.513015 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-bbf1ee68-5e69-4e7f-bdd8-89d6119e4da1 req-bcd5c335-c68d-4c13-a189-a63da5031530 service nova] Creating event network-changed:d0fdc6da-2556-482e-ad5d-5bef103df0d3 for instance edc297fd-3aa2-4bc4-b6e4-0be967fe7838 on hv-cinder-85367 Aug 18 17:15:22.518691 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-bbf1ee68-5e69-4e7f-bdd8-89d6119e4da1 req-bcd5c335-c68d-4c13-a189-a63da5031530 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040372 Aug 18 17:15:22.519849 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 578/1110] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:22.564989 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:22.565719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:22.573126 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:22.573612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:22.574237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:22.574942 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:22.575395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:22.575834 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:22.789949 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:22.799528 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-4061f5f0-b886-46a8-b4b0-00f067715cb7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.238734 Aug 18 17:15:22.800983 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 579/1111] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:22 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:22.833400 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:22.834108 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e0b6a93f-2c32-4ca3-bfd3-49418d7455ad tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1315 microversion: 2.1 time: 0.363013 Aug 18 17:15:22.834681 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 533/1112] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:22 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:23.820082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:23.820731 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:23.827164 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:23.827673 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:23.828112 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:23.828798 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:23.829242 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:23.829662 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:23.847878 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=100 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:23.854573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:23.855194 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:23.857879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:23.863295 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:23.863830 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:23.864471 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:23.865172 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:23.865636 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:23.866068 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:24.036232 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:24.044493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-67597003-d90f-4e44-a628-f856350330c0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1315 microversion: 2.1 time: 0.193693 Aug 18 17:15:24.045075 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 534/1113] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:23 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:24.048286 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:24.056611 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e130fef5-7b3b-45d8-a68c-76ed21fa6c1d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.240406 Aug 18 17:15:24.057359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 580/1114] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:23 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:25.065465 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:25.066086 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:25.073167 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:25.073652 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:25.074081 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:25.074772 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:25.075223 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:25.075667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:25.077359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:25.078056 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:25.081109 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=10 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:25.085689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:25.086271 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:25.086710 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:25.087449 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:25.087920 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:25.088375 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:25.208498 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:25.216698 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-36c7f705-8ae1-4488-9576-9f41d8e2f6e8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1315 microversion: 2.1 time: 0.155111 Aug 18 17:15:25.217337 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 535/1115] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:25 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:25.229044 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:25.234711 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1715236f-2eda-4ad2-8676-d85fe97ef863 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.161188 Aug 18 17:15:25.235288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 581/1116] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:25 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:26.240829 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:26.241401 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:26.247790 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:26.248275 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:26.257547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:26.257547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:26.257547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:26.257547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:26.257912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:26.257912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:26.263214 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:26.263741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:26.264188 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:26.264886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:26.265342 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:26.265772 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:26.385343 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:26.394082 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e1fc8e4f-5fae-4a48-a92e-23b436dfa039 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1315 microversion: 2.1 time: 0.157681 Aug 18 17:15:26.394661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 536/1117] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:26 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:26.407535 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:26.415559 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-bbb7ff51-f90d-4d0a-a266-f7f278efd163 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.163776 Aug 18 17:15:26.416128 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 582/1118] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:26 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:27.415522 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:27.416164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:27.418053 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=14 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:27.423421 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:27.423945 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:27.424389 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:27.425093 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:27.425556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:27.425979 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:27.438249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:27.438857 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:27.447741 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:27.448820 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:27.449601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:27.450504 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:27.451129 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:27.451601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:27.571868 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:27.579964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c668e5fa-416b-4f59-a5b2-707b737e4dfd tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1315 microversion: 2.1 time: 0.168391 Aug 18 17:15:27.580620 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 537/1119] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:27 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:27.606543 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:27.614339 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-177104d9-c270-45a1-ac0c-f6ad42a3df89 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.180365 Aug 18 17:15:27.614931 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 583/1120] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:27 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:27.785282 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-6ac6e36c-0643-4ba6-b045-279000247c85 req-59eb7850-78b0-43f5-8bca-c6694b789da3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc297fd-3aa2-4bc4-b6e4-0be967fe7838", "name": "network-vif-plugged", "status": "completed", "tag": "d0fdc6da-2556-482e-ad5d-5bef103df0d3"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:27.794828 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-6ac6e36c-0643-4ba6-b045-279000247c85 req-59eb7850-78b0-43f5-8bca-c6694b789da3 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:27.796456 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-6ac6e36c-0643-4ba6-b045-279000247c85 req-59eb7850-78b0-43f5-8bca-c6694b789da3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:27.796456 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-6ac6e36c-0643-4ba6-b045-279000247c85 req-59eb7850-78b0-43f5-8bca-c6694b789da3 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:27.806453 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-6ac6e36c-0643-4ba6-b045-279000247c85 req-59eb7850-78b0-43f5-8bca-c6694b789da3 service nova] Creating event network-vif-plugged:d0fdc6da-2556-482e-ad5d-5bef103df0d3 for instance edc297fd-3aa2-4bc4-b6e4-0be967fe7838 on hv-cinder-85367 Aug 18 17:15:27.811594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-6ac6e36c-0643-4ba6-b045-279000247c85 req-59eb7850-78b0-43f5-8bca-c6694b789da3 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030082 Aug 18 17:15:27.812202 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 538/1121] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:15:28.601753 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:28.602358 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:28.608898 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:28.609392 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:28.609805 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:28.610495 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:28.610948 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:28.611365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:28.637311 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:28.637942 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:28.644589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:28.645068 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:28.645503 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:28.646215 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:28.646670 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:28.647086 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:28.748704 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:28.756872 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-251e1788-d4d4-4f57-9807-e48611ecf0f6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1315 microversion: 2.1 time: 0.159428 Aug 18 17:15:28.757453 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 584/1122] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:28 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:28.786024 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:28.794388 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e6b533aa-a065-4789-b1af-34274f0e6e8c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.161765 Aug 18 17:15:28.794967 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 539/1123] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:28 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:29.778665 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:29.780250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:29.787267 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:29.787870 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:29.788381 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:29.789120 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:29.789589 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:29.790004 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:29.815657 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:29.816303 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:29.824000 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:29.824869 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:29.825846 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:29.827167 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:29.827882 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:29.838676 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:29.934120 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:29.942019 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e0bc153f-a54b-41eb-9988-f50c2524bb70 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1315 microversion: 2.1 time: 0.167881 Aug 18 17:15:29.943173 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 585/1124] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:29 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:29.947713 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-cf4e15c8-f252-4d25-b437-082c48b979c2 req-27a15e47-e025-482c-93ad-81575eb88b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe99c95-ce5b-467a-92d4-15b02ac57d02", "name": "network-vif-plugged", "status": "completed", "tag": "ae35b8e6-3767-4d67-8189-4241efe3de81"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:29.957123 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-cf4e15c8-f252-4d25-b437-082c48b979c2 req-27a15e47-e025-482c-93ad-81575eb88b2e service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:29.957603 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-cf4e15c8-f252-4d25-b437-082c48b979c2 req-27a15e47-e025-482c-93ad-81575eb88b2e service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:29.958071 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-cf4e15c8-f252-4d25-b437-082c48b979c2 req-27a15e47-e025-482c-93ad-81575eb88b2e service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:29.974433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-cf4e15c8-f252-4d25-b437-082c48b979c2 req-27a15e47-e025-482c-93ad-81575eb88b2e service nova] Creating event network-vif-plugged:ae35b8e6-3767-4d67-8189-4241efe3de81 for instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 on hv-cinder-85367 Aug 18 17:15:29.974547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:29.976712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-cf4e15c8-f252-4d25-b437-082c48b979c2 req-27a15e47-e025-482c-93ad-81575eb88b2e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032356 Aug 18 17:15:29.977316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 586/1125] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:29.980469 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e77f773c-14db-425f-8fc9-e96ffe45525a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.168818 Aug 18 17:15:29.981064 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 540/1126] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:29 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:30.964008 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:30.964709 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:30.971301 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:30.971818 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:30.972256 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:30.972953 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:30.973412 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:30.974390 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:31.004418 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:31.005278 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:31.011792 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:31.012276 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:31.012713 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:31.013411 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:31.013869 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:31.014293 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:31.030025 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:31.111925 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:31.120646 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0ca74616-3f48-4447-84bd-80a3676a762b tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1463 microversion: 2.1 time: 0.160880 Aug 18 17:15:31.121240 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 587/1127] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:30 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:31.150443 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:31.158368 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-db127151-e247-44e6-ad5e-0948a0583d22 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1265 microversion: 2.1 time: 0.157712 Aug 18 17:15:31.158935 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 541/1128] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:30 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:31.167671 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:31.168165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:31.174191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:31.174668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:31.175095 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:31.175800 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:31.176249 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:31.176663 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:31.201284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:15:31.612852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-e625aa39-ca7f-4455-a476-df86a0abdfb3 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "DELETE /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 204 len: 0 microversion: 2.1 time: 0.448613 Aug 18 17:15:31.613475 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 588/1129] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:15:31 2022] DELETE /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:15:31.622188 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:31.622783 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:31.628803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:31.629297 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:31.629719 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:31.630912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:31.631374 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:31.631904 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:31.767853 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:31.776192 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e35c5b53-8c63-402b-9441-e9146a9c32e0 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1469 microversion: 2.1 time: 0.158273 Aug 18 17:15:31.782797 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 542/1130] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:31 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:15:32.180492 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:32.181235 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:32.187637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.188120 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.188549 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:32.189242 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.189691 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.190108 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:32.326315 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:32.334197 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-dcace340-976d-4023-9c4e-63045d0bf26e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1452 microversion: 2.1 time: 0.158551 Aug 18 17:15:32.334763 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 589/1131] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:32 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:32.354640 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:32.355410 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:32.361937 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.362424 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.362865 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:32.363596 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.364059 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.365094 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:32.501612 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:32.510630 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-5dc48733-68cf-46b7-a263-f2d044dfed5f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1452 microversion: 2.1 time: 0.159914 Aug 18 17:15:32.511208 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 543/1132] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:32 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:32.797388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:32.798035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:32.804067 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.804602 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.805048 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:32.805752 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:32.806209 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:32.806712 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:33.037884 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:33.046035 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-96a01fb9-405e-4889-b663-d0b157a099d8 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1469 microversion: 2.1 time: 0.252637 Aug 18 17:15:33.046630 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 590/1133] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:32 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1469 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:34.068066 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:34.068709 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:34.075310 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.075850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.076291 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:34.076999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.077457 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.077884 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:34.221230 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:34.231701 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d523540b-56f1-4775-abc7-e7ad2b61afa9 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1469 microversion: 2.1 time: 0.167235 Aug 18 17:15:34.231701 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 544/1134] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:34 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:34.318566 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-e84e1ebf-6a00-4b3b-9b17-1bb2c480bc1f req-f4cc3c02-1a90-4127-a780-b96822ec2966 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc297fd-3aa2-4bc4-b6e4-0be967fe7838", "name": "network-vif-deleted", "tag": "d0fdc6da-2556-482e-ad5d-5bef103df0d3"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:34.328640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-e84e1ebf-6a00-4b3b-9b17-1bb2c480bc1f req-f4cc3c02-1a90-4127-a780-b96822ec2966 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:34.329120 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-e84e1ebf-6a00-4b3b-9b17-1bb2c480bc1f req-f4cc3c02-1a90-4127-a780-b96822ec2966 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:34.329548 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-e84e1ebf-6a00-4b3b-9b17-1bb2c480bc1f req-f4cc3c02-1a90-4127-a780-b96822ec2966 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:34.342932 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-e84e1ebf-6a00-4b3b-9b17-1bb2c480bc1f req-f4cc3c02-1a90-4127-a780-b96822ec2966 service nova] Creating event network-vif-deleted:d0fdc6da-2556-482e-ad5d-5bef103df0d3 for instance edc297fd-3aa2-4bc4-b6e4-0be967fe7838 on hv-cinder-85367 Aug 18 17:15:34.348325 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-e84e1ebf-6a00-4b3b-9b17-1bb2c480bc1f req-f4cc3c02-1a90-4127-a780-b96822ec2966 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033418 Aug 18 17:15:34.349886 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 591/1135] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:35.252142 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:35.252762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:35.261022 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:35.261512 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:35.261947 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:35.262653 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:35.263154 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:35.263624 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:35.308220 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:35.308874 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:35.309396 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:35.309861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lazy-loading 'fault' on Instance uuid edc297fd-3aa2-4bc4-b6e4-0be967fe7838 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:15:35.352532 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '049226c3e32f488e90e1520976ae1fed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '692bb1c3de754fd98526bc68fda47c91', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:15:35.360670 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-06bb03ad-7b99-4def-a09a-0ec5ad9af2c6 tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 200 len: 1305 microversion: 2.1 time: 0.112412 Aug 18 17:15:35.361260 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 545/1136] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:35 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 1305 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:15:36.364603 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-1b0bf69b-72e3-4a32-a8ed-ca7b51c4170b req-6c03ea62-bb60-4116-b8ba-beccfcedb32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe99c95-ce5b-467a-92d4-15b02ac57d02", "tag": "ae35b8e6-3767-4d67-8189-4241efe3de81"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:36.374144 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1b0bf69b-72e3-4a32-a8ed-ca7b51c4170b req-6c03ea62-bb60-4116-b8ba-beccfcedb32c service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:36.374622 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1b0bf69b-72e3-4a32-a8ed-ca7b51c4170b req-6c03ea62-bb60-4116-b8ba-beccfcedb32c service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:36.375084 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1b0bf69b-72e3-4a32-a8ed-ca7b51c4170b req-6c03ea62-bb60-4116-b8ba-beccfcedb32c service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:36.382613 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:36.383324 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] [instance: edc297fd-3aa2-4bc4-b6e4-0be967fe7838] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:36.387373 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-1b0bf69b-72e3-4a32-a8ed-ca7b51c4170b req-6c03ea62-bb60-4116-b8ba-beccfcedb32c service nova] Creating event network-changed:ae35b8e6-3767-4d67-8189-4241efe3de81 for instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 on hv-cinder-85367 Aug 18 17:15:36.390267 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:36.390762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:36.391195 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:36.391924 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:36.392378 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:36.392594 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-1b0bf69b-72e3-4a32-a8ed-ca7b51c4170b req-6c03ea62-bb60-4116-b8ba-beccfcedb32c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032970 Aug 18 17:15:36.392812 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:36.393466 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 592/1137] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:36.407670 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] HTTP exception thrown: Instance edc297fd-3aa2-4bc4-b6e4-0be967fe7838 could not be found. Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Request method failure captured: Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 HTTP/1.1 Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nOchXJSJ5KSszbabdWlkXAKHHYjeVAe4Mpr5apr5sGkc4hCGXipxlvmk2aWPbL_SlIdIKlpfbCoTbGXEb5nIBg4fL0pTU83QsdTRfryADx_GmnupJ271IBwhmGaN7rnpdzeM0POvFsHDd7XfJ48kCtyML3QCB_4kvP633yItrniwvk Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 692bb1c3de754fd98526bc68fda47c91 Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-VolumesNegativeTest-1840446367 Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:15:36.409067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/692bb1c3de754fd98526bc68fda47c91"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/692bb1c3de754fd98526bc68fda47c91"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/692bb1c3de754fd98526bc68fda47c91"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_692bb1c3de754fd98526bc68fda47c91", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-VolumesNegativeTest-1840446367 Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 692bb1c3de754fd98526bc68fda47c91 Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-VolumesNegativeTest-1840446367 Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-VolumesNegativeTest-1840446367-project Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: 049226c3e32f488e90e1520976ae1fed Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-VolumesNegativeTest-1840446367-project Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance edc297fd-3aa2-4bc4-b6e4-0be967fe7838 could not be found. Aug 18 17:15:36.410854 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': 'edc297fd-3aa2-4bc4-b6e4-0be967fe7838'} Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc297fd-3aa2-4bc4-b6e4-0be967fe7838 could not be found. Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:15:36.411791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc297fd-3aa2-4bc4-b6e4-0be967fe7838 could not be found. Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc297fd-3aa2-4bc4-b6e4-0be967fe7838 could not be found. Aug 18 17:15:36.413960 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:15:36.416775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] Returning 404 to user: Instance edc297fd-3aa2-4bc4-b6e4-0be967fe7838 could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:15:36.416775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-41120cb4-efe3-4994-83b6-d4355b625b9d tempest-VolumesNegativeTest-1840446367 tempest-VolumesNegativeTest-1840446367-project] 10.222.0.78 "GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838" status: 404 len: 111 microversion: 2.1 time: 0.032588 Aug 18 17:15:36.416775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 546/1138] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:15:36 2022] GET /compute/v2.1/servers/edc297fd-3aa2-4bc4-b6e4-0be967fe7838 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:15:42.478025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-a94d576d-ee74-4362-9950-833541c3d7ed tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:42.478616 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-a94d576d-ee74-4362-9950-833541c3d7ed tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:42.480604 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:42.485408 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d576d-ee74-4362-9950-833541c3d7ed tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:42.485892 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d576d-ee74-4362-9950-833541c3d7ed tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:42.486395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d576d-ee74-4362-9950-833541c3d7ed tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:42.487058 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d576d-ee74-4362-9950-833541c3d7ed tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:42.487529 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d576d-ee74-4362-9950-833541c3d7ed tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:42.487944 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-a94d576d-ee74-4362-9950-833541c3d7ed tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:42.511080 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-a94d576d-ee74-4362-9950-833541c3d7ed tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/ips" status: 200 len: 144 microversion: 2.1 time: 0.038619 Aug 18 17:15:42.514158 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 593/1139] 10.222.0.78 () {58 vars in 1248 bytes} [Thu Aug 18 17:15:42 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/ips => generated 144 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:44.282889 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-e80a23b5-6e46-41e4-9954-ad9991cae665 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b943afa4-f122-494d-9117-f6a9b145e71d"}} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:44.285312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-e80a23b5-6e46-41e4-9954-ad9991cae665 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:44.288058 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:44.293549 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e80a23b5-6e46-41e4-9954-ad9991cae665 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:44.294116 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e80a23b5-6e46-41e4-9954-ad9991cae665 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:44.294627 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e80a23b5-6e46-41e4-9954-ad9991cae665 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:44.295493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e80a23b5-6e46-41e4-9954-ad9991cae665 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:44.296021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e80a23b5-6e46-41e4-9954-ad9991cae665 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:44.296509 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-e80a23b5-6e46-41e4-9954-ad9991cae665 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:46.165467 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-e80a23b5-6e46-41e4-9954-ad9991cae665 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.886763 Aug 18 17:15:46.166143 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 547/1140] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:15:44 2022] POST /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments => generated 194 bytes in 1888 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:53.715154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-14863967-80a7-4899-8d3c-dd63db2c7454 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:53.717382 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-14863967-80a7-4899-8d3c-dd63db2c7454 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:53.720180 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:15:53.725153 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14863967-80a7-4899-8d3c-dd63db2c7454 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:53.725637 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14863967-80a7-4899-8d3c-dd63db2c7454 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:53.726077 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14863967-80a7-4899-8d3c-dd63db2c7454 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:53.726785 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14863967-80a7-4899-8d3c-dd63db2c7454 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:53.727241 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14863967-80a7-4899-8d3c-dd63db2c7454 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:53.727736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-14863967-80a7-4899-8d3c-dd63db2c7454 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:53.759131 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-14863967-80a7-4899-8d3c-dd63db2c7454 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047867 Aug 18 17:15:53.759736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 594/1141] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:15:53 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:53.771592 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-4a8f0d27-5fca-4c2d-8a00-ad9684f598d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:15:53.772176 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-4a8f0d27-5fca-4c2d-8a00-ad9684f598d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:53.778401 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a8f0d27-5fca-4c2d-8a00-ad9684f598d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:53.778879 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a8f0d27-5fca-4c2d-8a00-ad9684f598d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:53.779326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a8f0d27-5fca-4c2d-8a00-ad9684f598d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:53.780037 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a8f0d27-5fca-4c2d-8a00-ad9684f598d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:53.780497 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a8f0d27-5fca-4c2d-8a00-ad9684f598d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:53.780917 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-4a8f0d27-5fca-4c2d-8a00-ad9684f598d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:53.810958 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-4a8f0d27-5fca-4c2d-8a00-ad9684f598d5 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/b943afa4-f122-494d-9117-f6a9b145e71d" status: 200 len: 194 microversion: 2.1 time: 0.044135 Aug 18 17:15:53.811554 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 548/1142] 10.222.0.78 () {58 vars in 1413 bytes} [Thu Aug 18 17:15:53 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/b943afa4-f122-494d-9117-f6a9b145e71d => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:15:55.504288 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-08f09788-f274-466e-89b4-d956da1a3986 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6fe25cc6-1cfe-43a7-b9f9-a04a9d9d8ef4"}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:15:55.507061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-08f09788-f274-466e-89b4-d956da1a3986 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:15:55.514634 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08f09788-f274-466e-89b4-d956da1a3986 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:55.515121 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08f09788-f274-466e-89b4-d956da1a3986 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:55.515608 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08f09788-f274-466e-89b4-d956da1a3986 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:55.516309 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08f09788-f274-466e-89b4-d956da1a3986 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:15:55.516764 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08f09788-f274-466e-89b4-d956da1a3986 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:15:55.517191 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-08f09788-f274-466e-89b4-d956da1a3986 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:15:56.967223 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-08f09788-f274-466e-89b4-d956da1a3986 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "POST /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.467447 Aug 18 17:15:56.968039 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 595/1143] 10.222.0.78 () {60 vars in 1323 bytes} [Thu Aug 18 17:15:55 2022] POST /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments => generated 194 bytes in 1469 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:05.561454 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3ba5d410-ce0d-462d-b563-3ea9e8bcf909 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:05.563823 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3ba5d410-ce0d-462d-b563-3ea9e8bcf909 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:05.566431 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=3 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:05.567191 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:05.571925 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3ba5d410-ce0d-462d-b563-3ea9e8bcf909 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:05.572416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3ba5d410-ce0d-462d-b563-3ea9e8bcf909 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:05.572861 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3ba5d410-ce0d-462d-b563-3ea9e8bcf909 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:05.573564 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3ba5d410-ce0d-462d-b563-3ea9e8bcf909 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:05.574028 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3ba5d410-ce0d-462d-b563-3ea9e8bcf909 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:05.574455 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3ba5d410-ce0d-462d-b563-3ea9e8bcf909 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:05.607245 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3ba5d410-ce0d-462d-b563-3ea9e8bcf909 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.049822 Aug 18 17:16:05.607855 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 549/1144] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:16:05 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments => generated 371 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:05.748932 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=5 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:16:05.753118 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-dee24e86-6999-4d5a-8e59-ea7272f3c32d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:05.753939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-dee24e86-6999-4d5a-8e59-ea7272f3c32d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:05.760107 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dee24e86-6999-4d5a-8e59-ea7272f3c32d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:05.765813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dee24e86-6999-4d5a-8e59-ea7272f3c32d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:05.765813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dee24e86-6999-4d5a-8e59-ea7272f3c32d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:05.765813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dee24e86-6999-4d5a-8e59-ea7272f3c32d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:05.765813 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dee24e86-6999-4d5a-8e59-ea7272f3c32d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:05.766369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-dee24e86-6999-4d5a-8e59-ea7272f3c32d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:05.792956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-dee24e86-6999-4d5a-8e59-ea7272f3c32d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/b943afa4-f122-494d-9117-f6a9b145e71d" status: 200 len: 194 microversion: 2.1 time: 0.045547 Aug 18 17:16:05.793537 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 596/1145] 10.222.0.78 () {58 vars in 1413 bytes} [Thu Aug 18 17:16:05 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/b943afa4-f122-494d-9117-f6a9b145e71d => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:05.804579 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:05.805107 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:05.811916 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:05.812403 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:05.812857 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:05.813541 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:05.813998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:05.814417 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:05.896619 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lazy-loading 'services' on Instance uuid 585ef3ab-09d6-4564-8ddb-669ac58ed47a {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:16:06.314737 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-20c45f14-8031-49cd-a974-9084a0da4208 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/b943afa4-f122-494d-9117-f6a9b145e71d" status: 202 len: 0 microversion: 2.1 time: 0.514828 Aug 18 17:16:06.326201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 550/1146] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:16:05 2022] DELETE /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/b943afa4-f122-494d-9117-f6a9b145e71d => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:16:08.491871 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c051d0f4-56e5-41e5-aab7-9b36ee190f6e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:08.492399 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c051d0f4-56e5-41e5-aab7-9b36ee190f6e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:08.498956 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c051d0f4-56e5-41e5-aab7-9b36ee190f6e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:08.499467 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c051d0f4-56e5-41e5-aab7-9b36ee190f6e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:08.499917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c051d0f4-56e5-41e5-aab7-9b36ee190f6e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:08.500612 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c051d0f4-56e5-41e5-aab7-9b36ee190f6e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:08.501074 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c051d0f4-56e5-41e5-aab7-9b36ee190f6e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:08.501498 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c051d0f4-56e5-41e5-aab7-9b36ee190f6e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:08.530343 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c051d0f4-56e5-41e5-aab7-9b36ee190f6e tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/6fe25cc6-1cfe-43a7-b9f9-a04a9d9d8ef4" status: 200 len: 194 microversion: 2.1 time: 0.043087 Aug 18 17:16:08.530948 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 597/1147] 10.222.0.78 () {58 vars in 1413 bytes} [Thu Aug 18 17:16:08 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/6fe25cc6-1cfe-43a7-b9f9-a04a9d9d8ef4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:08.543130 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:08.543758 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:08.549949 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:08.551594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:08.551594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:08.551594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:08.552110 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:08.552539 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:08.633499 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lazy-loading 'services' on Instance uuid 585ef3ab-09d6-4564-8ddb-669ac58ed47a {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:16:08.882354 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fef7e5b1-63ba-4265-8a78-dd8a4acbbfc0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/6fe25cc6-1cfe-43a7-b9f9-a04a9d9d8ef4" status: 202 len: 0 microversion: 2.1 time: 0.343779 Aug 18 17:16:08.882955 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 551/1148] 10.222.0.78 () {58 vars in 1416 bytes} [Thu Aug 18 17:16:08 2022] DELETE /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments/6fe25cc6-1cfe-43a7-b9f9-a04a9d9d8ef4 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:16:10.061455 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-71c88c8c-fb6f-41b3-bdfb-6c088355f9bc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:10.063940 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-71c88c8c-fb6f-41b3-bdfb-6c088355f9bc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:10.070860 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71c88c8c-fb6f-41b3-bdfb-6c088355f9bc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:10.071361 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71c88c8c-fb6f-41b3-bdfb-6c088355f9bc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:10.071839 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71c88c8c-fb6f-41b3-bdfb-6c088355f9bc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:10.072546 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71c88c8c-fb6f-41b3-bdfb-6c088355f9bc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:10.073006 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71c88c8c-fb6f-41b3-bdfb-6c088355f9bc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:10.073439 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-71c88c8c-fb6f-41b3-bdfb-6c088355f9bc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:10.103818 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-71c88c8c-fb6f-41b3-bdfb-6c088355f9bc tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046402 Aug 18 17:16:10.104383 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 598/1149] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:16:10 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:16:10.218659 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-0f1f607e-2fc3-476b-8e57-ab465a4cc213 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:10.221047 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-0f1f607e-2fc3-476b-8e57-ab465a4cc213 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:10.227967 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0f1f607e-2fc3-476b-8e57-ab465a4cc213 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:10.228456 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0f1f607e-2fc3-476b-8e57-ab465a4cc213 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:10.228892 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0f1f607e-2fc3-476b-8e57-ab465a4cc213 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:10.229598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0f1f607e-2fc3-476b-8e57-ab465a4cc213 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:10.231825 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0f1f607e-2fc3-476b-8e57-ab465a4cc213 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:10.232268 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-0f1f607e-2fc3-476b-8e57-ab465a4cc213 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:10.264527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-0f1f607e-2fc3-476b-8e57-ab465a4cc213 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050522 Aug 18 17:16:10.265089 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 552/1150] 10.222.0.78 () {58 vars in 1302 bytes} [Thu Aug 18 17:16:10 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 18 17:16:10.326164 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:10.326670 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:10.332642 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:10.333127 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:10.333564 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:10.334258 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:10.334716 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:10.335668 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:10.360713 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:16:10.717457 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-f7abd98f-a04e-4be0-a6c9-fb0777f59d3d tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 204 len: 0 microversion: 2.1 time: 0.394812 Aug 18 17:16:10.718047 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 599/1151] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:16:10 2022] DELETE /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:16:10.726456 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:10.727080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:10.733146 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:10.733637 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:10.734116 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:10.734807 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:10.735266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:10.735769 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:10.876533 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:10.885292 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-bcbe2c7a-ab02-4c49-9196-907326fbb8a8 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1669 microversion: 2.1 time: 0.162930 Aug 18 17:16:10.885874 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 553/1152] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:10 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:11.906847 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:11.907590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:11.914094 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:11.914581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:11.915647 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:11.916356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:11.916822 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:11.917250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:12.047070 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:12.055038 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9d1075f9-e912-4b02-8ab3-8bf9bf573b04 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1669 microversion: 2.1 time: 0.152458 Aug 18 17:16:12.055654 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 600/1153] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:11 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1669 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:13.078652 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:13.079287 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:13.086775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:13.087569 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:13.088461 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:13.089287 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:13.089877 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:13.090313 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:13.158483 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:13.166661 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-3d1961ae-d174-49a9-a53f-b4f54026b1e6 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1602 microversion: 2.1 time: 0.092330 Aug 18 17:16:13.167851 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 554/1154] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:13 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1602 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:13.609388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-8a790ecf-72ee-42eb-8852-fb026c6ba317 req-8e94a53e-0ba7-4db6-b95f-3da082964154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "585ef3ab-09d6-4564-8ddb-669ac58ed47a", "name": "network-vif-deleted", "tag": "b60c8ba3-c3f4-49f7-96ff-a5a0b979e4d7"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:16:13.620115 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-8a790ecf-72ee-42eb-8852-fb026c6ba317 req-8e94a53e-0ba7-4db6-b95f-3da082964154 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:13.621001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-8a790ecf-72ee-42eb-8852-fb026c6ba317 req-8e94a53e-0ba7-4db6-b95f-3da082964154 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:13.621657 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-8a790ecf-72ee-42eb-8852-fb026c6ba317 req-8e94a53e-0ba7-4db6-b95f-3da082964154 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:13.639769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-8a790ecf-72ee-42eb-8852-fb026c6ba317 req-8e94a53e-0ba7-4db6-b95f-3da082964154 service nova] Creating event network-vif-deleted:b60c8ba3-c3f4-49f7-96ff-a5a0b979e4d7 for instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a on hv-cinder-85367 Aug 18 17:16:13.645765 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-8a790ecf-72ee-42eb-8852-fb026c6ba317 req-8e94a53e-0ba7-4db6-b95f-3da082964154 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.289129 Aug 18 17:16:13.646554 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 601/1155] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:16:14.188308 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:14.188980 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:14.196138 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:14.196634 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:14.197077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:14.197791 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:14.198255 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:14.198672 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:14.233299 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:14.233823 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:14.234306 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:14.234726 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lazy-loading 'fault' on Instance uuid 585ef3ab-09d6-4564-8ddb-669ac58ed47a {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:16:14.281114 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd909457b883345c982916c842926836d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44e1819d40894e26bfbe20d58589823f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:16:14.289283 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b90065d1-bc3a-4d1e-a6a7-186790c9e783 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 200 len: 1325 microversion: 2.1 time: 0.104714 Aug 18 17:16:14.290201 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 555/1156] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:14 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 1325 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:16:15.313633 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:15.314394 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:15.320826 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:15.321306 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:15.321736 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:15.322459 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:15.322908 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:15.323326 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:15.337061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] HTTP exception thrown: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Request method failure captured: Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a HTTP/1.1 Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nK4cUIAls61t07tY5K7IxoJcGbFydnUxzKH4LKHxuS0Ux5Q6hCoO8yYTSqMOHkinJjlcb3v6odSh-SZnuCZPskiD-77vlVbjx7jHQ0r1Q7MEz8rV4qI0ghEe-aOnWnbBMXDf3SPzeyiwjB_iqP1A0cdaMEbMhCpiQyG1aSMdCpFPkw Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:16:15.338706 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44e1819d40894e26bfbe20d58589823f", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: d909457b883345c982916c842926836d Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:15.340395 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '585ef3ab-09d6-4564-8ddb-669ac58ed47a'} Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:16:15.341501 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:15.342863 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:15.344489 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Returning 404 to user: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:16:15.344489 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-45a81ad4-d0f0-439f-9ac7-d34352565f3f tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 404 len: 111 microversion: 2.1 time: 0.031277 Aug 18 17:16:15.344489 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 602/1157] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:15 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:16:15.349240 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-9abe0d67-5a64-4b81-8375-b614d11000c1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '.version_select at 0x7ff5b4ce2310>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:15.424195 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-9abe0d67-5a64-4b81-8375-b614d11000c1 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-788467178" status: 202 len: 0 microversion: 2.1 time: 0.078822 Aug 18 17:16:15.424894 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 556/1158] 10.222.0.78 () {58 vars in 1218 bytes} [Thu Aug 18 17:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-788467178 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 18 17:16:19.081504 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:19.082030 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:19.088285 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:19.088771 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:19.089211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:19.089912 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:19.090375 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:19.090802 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:19.104388 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] HTTP exception thrown: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Request method failure captured: Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a HTTP/1.1 Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nK4cUIAls61t07tY5K7IxoJcGbFydnUxzKH4LKHxuS0Ux5Q6hCoO8yYTSqMOHkinJjlcb3v6odSh-SZnuCZPskiD-77vlVbjx7jHQ0r1Q7MEz8rV4qI0ghEe-aOnWnbBMXDf3SPzeyiwjB_iqP1A0cdaMEbMhCpiQyG1aSMdCpFPkw Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:16:19.119297 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44e1819d40894e26bfbe20d58589823f", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: d909457b883345c982916c842926836d Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.121061 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '585ef3ab-09d6-4564-8ddb-669ac58ed47a'} Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:16:19.121997 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.123581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.125142 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Returning 404 to user: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:16:19.125142 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0efe6a89-06d4-4620-aa5c-b96930868b7b tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 404 len: 111 microversion: 2.1 time: 0.029695 Aug 18 17:16:19.125142 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 603/1159] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:16:19 2022] DELETE /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:16:19.126939 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:19.127589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 585ef3ab-09d6-4564-8ddb-669ac58ed47a] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:19.136883 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:19.137367 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:19.137803 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:19.138493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:19.138949 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:19.139375 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:19.152626 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] HTTP exception thrown: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Request method failure captured: Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a HTTP/1.1 Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nK4cUIAls61t07tY5K7IxoJcGbFydnUxzKH4LKHxuS0Ux5Q6hCoO8yYTSqMOHkinJjlcb3v6odSh-SZnuCZPskiD-77vlVbjx7jHQ0r1Q7MEz8rV4qI0ghEe-aOnWnbBMXDf3SPzeyiwjB_iqP1A0cdaMEbMhCpiQyG1aSMdCpFPkw Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:16:19.154273 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44e1819d40894e26bfbe20d58589823f", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: d909457b883345c982916c842926836d Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.155907 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '585ef3ab-09d6-4564-8ddb-669ac58ed47a'} Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:16:19.156826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. Aug 18 17:16:19.158327 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:19.159589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Returning 404 to user: Instance 585ef3ab-09d6-4564-8ddb-669ac58ed47a could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:16:19.159589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-fdf1826a-52f2-41a3-a562-812f43992072 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a" status: 404 len: 111 microversion: 2.1 time: 0.033435 Aug 18 17:16:19.159589 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 557/1160] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:19 2022] GET /compute/v2.1/servers/585ef3ab-09d6-4564-8ddb-669ac58ed47a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:16:20.718610 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:20.719293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:20.725922 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:20.726405 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:20.726848 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:20.727580 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:20.728032 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:20.728453 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:20.741871 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] HTTP exception thrown: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Request method failure captured: Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: DELETE /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d HTTP/1.1 Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nK4cUIAls61t07tY5K7IxoJcGbFydnUxzKH4LKHxuS0Ux5Q6hCoO8yYTSqMOHkinJjlcb3v6odSh-SZnuCZPskiD-77vlVbjx7jHQ0r1Q7MEz8rV4qI0ghEe-aOnWnbBMXDf3SPzeyiwjB_iqP1A0cdaMEbMhCpiQyG1aSMdCpFPkw Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:16:20.744146 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44e1819d40894e26bfbe20d58589823f", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: d909457b883345c982916c842926836d Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.745833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '08626bd0-6047-4258-a83d-efb24d789f0d'} Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:16:20.746645 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.748069 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.749779 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Returning 404 to user: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:16:20.749779 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-2070e2db-4e81-4930-9906-57fce07c22a0 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "DELETE /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 404 len: 111 microversion: 2.1 time: 0.030909 Aug 18 17:16:20.749779 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 604/1161] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:16:20 2022] DELETE /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:16:20.755261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:16:20.755900 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] [instance: 08626bd0-6047-4258-a83d-efb24d789f0d] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:16:20.762912 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:20.763393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:20.763857 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:20.764547 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:16:20.764997 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:16:20.765416 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:16:20.778753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] HTTP exception thrown: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Request method failure captured: Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d HTTP/1.1 Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nK4cUIAls61t07tY5K7IxoJcGbFydnUxzKH4LKHxuS0Ux5Q6hCoO8yYTSqMOHkinJjlcb3v6odSh-SZnuCZPskiD-77vlVbjx7jHQ0r1Q7MEz8rV4qI0ghEe-aOnWnbBMXDf3SPzeyiwjB_iqP1A0cdaMEbMhCpiQyG1aSMdCpFPkw Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:16:20.780318 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/44e1819d40894e26bfbe20d58589823f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_44e1819d40894e26bfbe20d58589823f", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: 44e1819d40894e26bfbe20d58589823f Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1787734949 Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: d909457b883345c982916c842926836d Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-AttachVolumeTestJSON-1787734949-project Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.785886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '08626bd0-6047-4258-a83d-efb24d789f0d'} Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:16:20.787866 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. Aug 18 17:16:20.789402 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:16:20.790747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] Returning 404 to user: Instance 08626bd0-6047-4258-a83d-efb24d789f0d could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:16:20.790747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-002cb7a6-c9cb-4021-a689-e5646fd3dc17 tempest-AttachVolumeTestJSON-1787734949 tempest-AttachVolumeTestJSON-1787734949-project] 10.222.0.78 "GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d" status: 404 len: 111 microversion: 2.1 time: 0.030577 Aug 18 17:16:20.790747 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 558/1162] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:16:20 2022] GET /compute/v2.1/servers/08626bd0-6047-4258-a83d-efb24d789f0d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:17:11.295085 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:17:11.295597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Thu Aug 18 17:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:17:25.106007 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:25.106759 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:25.110891 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-135157116", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-513148516", "security_groups": [{"name": "tempest-secgroup-smoke-1612543765"}], "block_device_mapping_v2": [{"uuid": "b7d1853f-10f9-4924-970f-43700882ced8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "744636b7-76bc-439f-9116-8e1ee85b3624"}]}} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:25.233523 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.network.neutron [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] validate_networks() for [('744636b7-76bc-439f-9116-8e1ee85b3624', None, None, None, None, None)] {{(pid=121267) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 18 17:17:25.998821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Flavor limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 18 17:17:25.998821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Image limits 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 18 17:17:25.998821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Flavor pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 18 17:17:25.998821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Image pref 0:0:0 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 18 17:17:25.998821 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.virt.hardware [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121267) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 18 17:17:26.006782 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:26.007256 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:26.007714 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:26.008428 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:26.008880 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:26.009296 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:26.027603 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Getting quotas for project c5e8eba08dfc4946becd6dba63f94eec. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 18 17:17:26.033256 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.quota [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Getting quotas for user f9d0f858ee07466a90d9c1ecf2c18c19 and project c5e8eba08dfc4946becd6dba63f94eec. Resources: {'instances', 'ram', 'cores'} {{(pid=121267) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 18 17:17:26.088041 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Going to run 1 instances... {{(pid=121267) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 18 17:17:26.090840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b7d1853f-10f9-4924-970f-43700882ced8',volume_size=None,volume_type=None)] {{(pid=121267) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1852}} Aug 18 17:17:26.578555 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0d63cea5-49f2-4c99-991e-c17f48f75f8d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.474102 Aug 18 17:17:26.585310 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 605/1163] 10.222.0.78 () {60 vars in 1147 bytes} [Thu Aug 18 17:17:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1481 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 18 17:17:26.591149 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ddc55e38-d87f-48fd-b230-78edbfed9fb0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:26.591800 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ddc55e38-d87f-48fd-b230-78edbfed9fb0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:26.596981 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:26.597635 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:26.653266 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ddc55e38-d87f-48fd-b230-78edbfed9fb0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:26.661656 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ddc55e38-d87f-48fd-b230-78edbfed9fb0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1093 microversion: 2.1 time: 0.075358 Aug 18 17:17:26.662222 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 559/1164] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:26 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1093 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:17:27.682511 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-25f19d44-bd6e-4d57-be79-ef9482d8533e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:27.683819 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-25f19d44-bd6e-4d57-be79-ef9482d8533e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:27.736795 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-25f19d44-bd6e-4d57-be79-ef9482d8533e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:27.744636 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-25f19d44-bd6e-4d57-be79-ef9482d8533e tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1093 microversion: 2.1 time: 0.066413 Aug 18 17:17:27.749814 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 606/1165] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:27 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:28.767065 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:28.767753 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:28.776338 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:28.776823 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:28.777264 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:28.777964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:28.778423 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:28.778850 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:28.841826 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:28.850876 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c64f7064-10ee-4435-9106-ef06e4a34097 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1191 microversion: 2.1 time: 0.087775 Aug 18 17:17:28.852080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 560/1166] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:28 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1191 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:29.873503 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:29.873503 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:29.880989 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:29.882427 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:29.883111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:29.883917 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:29.884365 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:29.884796 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:30.055521 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:30.071513 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-ac7536e0-b798-4fef-bd43-e9e318d8a08f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1277 microversion: 2.1 time: 0.204060 Aug 18 17:17:30.072111 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 607/1167] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:29 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:30.864162 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-1b16b897-4f83-44d6-8ad8-c7787ad4f1b0 req-99bd1225-3113-4e3a-b2cd-2bfa9013019b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d8882f-eb9d-4d78-817f-a8439224bba2", "tag": "f808cd21-3baf-4b05-8963-6d5edd94a102"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:30.878730 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-1b16b897-4f83-44d6-8ad8-c7787ad4f1b0 req-99bd1225-3113-4e3a-b2cd-2bfa9013019b service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:30.880901 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-1b16b897-4f83-44d6-8ad8-c7787ad4f1b0 req-99bd1225-3113-4e3a-b2cd-2bfa9013019b service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:30.880901 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-1b16b897-4f83-44d6-8ad8-c7787ad4f1b0 req-99bd1225-3113-4e3a-b2cd-2bfa9013019b service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:30.892889 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-1b16b897-4f83-44d6-8ad8-c7787ad4f1b0 req-99bd1225-3113-4e3a-b2cd-2bfa9013019b service nova] Creating event network-changed:f808cd21-3baf-4b05-8963-6d5edd94a102 for instance e6d8882f-eb9d-4d78-817f-a8439224bba2 on hv-cinder-85367 Aug 18 17:17:30.898534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-1b16b897-4f83-44d6-8ad8-c7787ad4f1b0 req-99bd1225-3113-4e3a-b2cd-2bfa9013019b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039079 Aug 18 17:17:30.899279 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 561/1168] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:17:31.098020 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:31.099747 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:31.105751 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:31.106237 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:31.106674 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:31.107379 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:31.107860 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:31.108284 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:31.279768 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:31.287901 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-492ae8df-e741-4e19-8bdf-38b6cca8c5cb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.193633 Aug 18 17:17:31.300760 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 608/1169] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:31 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:32.315789 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:32.316621 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:32.322998 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:32.323523 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:32.323955 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:32.324655 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:32.325326 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:32.325751 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:32.478358 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:32.478358 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-c37fa9bc-81d4-4d26-a636-fdc598ba87f7 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.166772 Aug 18 17:17:32.478358 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 562/1170] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:32 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:33.498761 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:33.499470 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:33.506276 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:33.506783 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:33.507240 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:33.507973 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:33.508419 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:33.508835 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:33.642320 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:33.650597 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-0d150818-9a7f-459b-9a48-f7ed8e380a4f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.156289 Aug 18 17:17:33.652025 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 609/1171] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:33 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:34.672911 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:34.673527 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:34.680156 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:34.680647 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:34.681173 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:34.681873 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:34.682334 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:34.682764 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:34.814349 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:34.822150 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-dc6f20c2-5bb2-41f3-bc3b-bb1a4c7d9a2f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.153196 Aug 18 17:17:34.822718 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 563/1172] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:34 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 18 17:17:35.843474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:35.844082 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:35.852200 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:35.853039 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:35.853788 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:35.854986 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:35.855848 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:35.856590 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:35.998001 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:36.005971 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-03fb678c-9f02-451c-aa4e-8dbb747e7746 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.167462 Aug 18 17:17:36.006689 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 610/1173] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:35 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:37.030632 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:37.031376 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:37.033906 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell0:SELECT=2 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:37.038843 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:37.043835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:37.043835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:37.043835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:37.043835 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:37.044333 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:37.177559 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:37.185774 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-b4532200-af20-46d4-a4ac-8878423ebe79 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.159032 Aug 18 17:17:37.186340 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 564/1174] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:37 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:38.206316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:38.207415 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:38.208833 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=2 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:38.209972 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell0:SELECT=8 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:17:38.214770 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:38.215246 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:38.215721 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:38.216414 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:38.216870 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:38.217293 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:38.355750 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:38.363385 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-1cb09d63-333b-4939-b7fd-e074f0b7bf4a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.160917 Aug 18 17:17:38.363969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 611/1175] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:38 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:39.384503 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:39.385114 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:39.392544 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:39.393062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:39.393510 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:39.394252 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:39.394707 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:39.395129 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:39.532763 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:39.540782 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ec6836e4-8d44-4e2c-9990-2aae1e8f879f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.160190 Aug 18 17:17:39.541973 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 565/1176] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:39 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:40.565340 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:40.566129 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:40.574723 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:40.575211 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:40.575687 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:40.576402 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:40.576866 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:40.577318 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:40.790913 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:40.798673 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-6c51ba59-be2e-4188-bad1-02d7a0047757 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.240237 Aug 18 17:17:40.799467 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 612/1177] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:40 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:41.820080 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:41.820700 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:41.827819 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:41.828312 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:41.828755 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:41.829468 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:41.829936 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:41.830371 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:41.975054 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:41.983301 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-a552ba72-45fb-4f40-bf90-d1b45a19302f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.167080 Aug 18 17:17:41.983891 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 566/1178] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:41 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:42.428808 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-1074ce4b-badf-4018-b220-3cb299e5693d req-674ca76f-b7c2-49d5-b672-6373de4c6605 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d8882f-eb9d-4d78-817f-a8439224bba2", "name": "network-vif-plugged", "status": "completed", "tag": "f808cd21-3baf-4b05-8963-6d5edd94a102"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:42.439500 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1074ce4b-badf-4018-b220-3cb299e5693d req-674ca76f-b7c2-49d5-b672-6373de4c6605 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:42.439931 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1074ce4b-badf-4018-b220-3cb299e5693d req-674ca76f-b7c2-49d5-b672-6373de4c6605 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:42.440972 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-1074ce4b-badf-4018-b220-3cb299e5693d req-674ca76f-b7c2-49d5-b672-6373de4c6605 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:42.452922 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-1074ce4b-badf-4018-b220-3cb299e5693d req-674ca76f-b7c2-49d5-b672-6373de4c6605 service nova] Creating event network-vif-plugged:f808cd21-3baf-4b05-8963-6d5edd94a102 for instance e6d8882f-eb9d-4d78-817f-a8439224bba2 on hv-cinder-85367 Aug 18 17:17:42.458014 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-1074ce4b-badf-4018-b220-3cb299e5693d req-674ca76f-b7c2-49d5-b672-6373de4c6605 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168729 Aug 18 17:17:42.458640 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 613/1179] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 18 17:17:43.006529 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:43.007174 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:43.014822 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:43.015304 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:43.015769 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:43.016477 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:43.016934 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:43.017385 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:43.153616 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:43.161405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-03bd51bd-8f18-4f08-8519-60123d24413a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.159085 Aug 18 17:17:43.161975 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 567/1180] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:43 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:44.183406 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:44.184164 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:44.190436 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:44.190927 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:44.191366 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:44.192092 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:44.192552 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:44.193016 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:44.332164 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:44.340407 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-78f38a35-0e67-41fb-abd4-2aea9a48efa1 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1265 microversion: 2.1 time: 0.161755 Aug 18 17:17:44.340970 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 614/1181] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:44 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:45.360940 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:45.361556 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:45.368045 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:45.368532 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:45.368971 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:45.370171 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:45.370630 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:45.371062 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:45.502020 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:45.509733 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-810811c5-1838-4934-b827-34642378ad47 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1451 microversion: 2.1 time: 0.152665 Aug 18 17:17:45.510375 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 568/1182] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:45 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:45.529369 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:17:45.530077 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:17:45.536389 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:45.536864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:45.537292 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:45.537970 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:45.538420 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:45.538835 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:45.669852 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:17:45.677433 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-38e2928e-8f97-4f09-b382-3f44eef95a82 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1451 microversion: 2.1 time: 0.151857 Aug 18 17:17:45.678003 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 615/1183] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:17:45 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:17:47.839851 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-0ab32390-acf4-4853-8a16-b9178e904035 req-7c414787-7976-471e-a2ae-1d31e28f1845 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d8882f-eb9d-4d78-817f-a8439224bba2", "tag": "f808cd21-3baf-4b05-8963-6d5edd94a102"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:17:47.850881 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-0ab32390-acf4-4853-8a16-b9178e904035 req-7c414787-7976-471e-a2ae-1d31e28f1845 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:17:47.851404 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-0ab32390-acf4-4853-8a16-b9178e904035 req-7c414787-7976-471e-a2ae-1d31e28f1845 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:17:47.851869 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-0ab32390-acf4-4853-8a16-b9178e904035 req-7c414787-7976-471e-a2ae-1d31e28f1845 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:17:47.863552 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-0ab32390-acf4-4853-8a16-b9178e904035 req-7c414787-7976-471e-a2ae-1d31e28f1845 service nova] Creating event network-changed:f808cd21-3baf-4b05-8963-6d5edd94a102 for instance e6d8882f-eb9d-4d78-817f-a8439224bba2 on hv-cinder-85367 Aug 18 17:17:47.868578 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-0ab32390-acf4-4853-8a16-b9178e904035 req-7c414787-7976-471e-a2ae-1d31e28f1845 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033256 Aug 18 17:17:47.869184 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 569/1184] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:19:12.409162 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:19:12.409903 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Thu Aug 18 17:19:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:19:17.617125 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:17.618440 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG dbcounter [-] [121267] Writing DB stats nova_cell1:SELECT=52 {{(pid=121267) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:17.621766 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_api:SELECT=24 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:17.622762 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG dbcounter [-] [121268] Writing DB stats nova_cell1:SELECT=52 {{(pid=121268) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 17:19:17.622892 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:17.623250 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:17.627743 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-e8b64089-d66e-4b5b-84b2-51ddb2263bf5 req-c62cb9fa-e351-47d2-b393-1bcf4c076984 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e6d8882f-eb9d-4d78-817f-a8439224bba2", "tag": "f808cd21-3baf-4b05-8963-6d5edd94a102"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:19:17.629378 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:17.629864 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:17.630289 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:17.631179 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:17.631657 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:17.632080 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:17.639534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-e8b64089-d66e-4b5b-84b2-51ddb2263bf5 req-c62cb9fa-e351-47d2-b393-1bcf4c076984 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:17.640289 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-e8b64089-d66e-4b5b-84b2-51ddb2263bf5 req-c62cb9fa-e351-47d2-b393-1bcf4c076984 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:17.640901 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-e8b64089-d66e-4b5b-84b2-51ddb2263bf5 req-c62cb9fa-e351-47d2-b393-1bcf4c076984 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:17.653520 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-e8b64089-d66e-4b5b-84b2-51ddb2263bf5 req-c62cb9fa-e351-47d2-b393-1bcf4c076984 service nova] Creating event network-changed:f808cd21-3baf-4b05-8963-6d5edd94a102 for instance e6d8882f-eb9d-4d78-817f-a8439224bba2 on hv-cinder-85367 Aug 18 17:19:17.659055 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-e8b64089-d66e-4b5b-84b2-51ddb2263bf5 req-c62cb9fa-e351-47d2-b393-1bcf4c076984 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039989 Aug 18 17:19:17.659689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 570/1185] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:19:17.660183 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Going to try to terminate instance {{(pid=121267) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:19:18.008508 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c4b4b55a-5d00-410c-b9ee-3e24f3cb27c2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 204 len: 0 microversion: 2.1 time: 0.392928 Aug 18 17:19:18.012941 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 616/1186] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:19:17 2022] DELETE /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:19:18.019530 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:18.022667 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:18.029180 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:18.029984 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:18.030628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:18.031585 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:18.032243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:18.032922 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:18.170739 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:18.178721 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-16445e64-6de6-4892-ab6d-02503aeb833d tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1575 microversion: 2.1 time: 0.164166 Aug 18 17:19:18.179311 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 571/1187] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:18 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1575 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:19.200713 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:19.201409 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:19.207818 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:19.208295 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:19.208722 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:19.209412 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:19.209861 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:19.210278 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:19.343359 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:19.351159 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-79485290-b8f5-414f-9f19-c9c7f57534c6 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1575 microversion: 2.1 time: 0.154695 Aug 18 17:19:19.351763 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 617/1188] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:19 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:20.092031 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [req-5d656a20-e33a-4b35-aba2-1c688088c8be req-a783d5d0-b58b-4b77-8e25-7b53a5159cbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e6d8882f-eb9d-4d78-817f-a8439224bba2", "name": "network-vif-deleted", "tag": "f808cd21-3baf-4b05-8963-6d5edd94a102"}]} {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:19:20.101269 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5d656a20-e33a-4b35-aba2-1c688088c8be req-a783d5d0-b58b-4b77-8e25-7b53a5159cbd service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:20.110383 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5d656a20-e33a-4b35-aba2-1c688088c8be req-a783d5d0-b58b-4b77-8e25-7b53a5159cbd service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:20.110383 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [req-5d656a20-e33a-4b35-aba2-1c688088c8be req-a783d5d0-b58b-4b77-8e25-7b53a5159cbd service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:20.113678 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.compute.server_external_events [req-5d656a20-e33a-4b35-aba2-1c688088c8be req-a783d5d0-b58b-4b77-8e25-7b53a5159cbd service nova] Creating event network-vif-deleted:f808cd21-3baf-4b05-8963-6d5edd94a102 for instance e6d8882f-eb9d-4d78-817f-a8439224bba2 on hv-cinder-85367 Aug 18 17:19:20.118863 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [req-5d656a20-e33a-4b35-aba2-1c688088c8be req-a783d5d0-b58b-4b77-8e25-7b53a5159cbd service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032033 Aug 18 17:19:20.119462 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 572/1189] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:19:20.373410 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:20.374106 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:20.380789 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:20.381280 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:20.381721 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:20.382429 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:20.382987 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:20.383422 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:20.448477 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:20.457450 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-86e15e68-7827-48f2-93a9-95c962746b6a tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1224 microversion: 2.1 time: 0.088720 Aug 18 17:19:20.458560 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 618/1190] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:20 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1224 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:21.479243 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:21.479977 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:21.486932 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:21.492067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:21.492067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:21.492067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:21.492067 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:21.492481 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:21.523901 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:21.524493 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:21.524930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:21.525378 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.objects.instance [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lazy-loading 'fault' on Instance uuid e6d8882f-eb9d-4d78-817f-a8439224bba2 {{(pid=121268) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 18 17:19:21.569683 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:21.578261 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-ced03bb4-aa70-4f88-9ee7-4fb4623361ee tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 200 len: 1229 microversion: 2.1 time: 0.103360 Aug 18 17:19:21.578818 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 573/1191] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:21 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 1229 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:22.599859 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:22.600472 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: e6d8882f-eb9d-4d78-817f-a8439224bba2] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:22.607531 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:22.608020 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:22.608456 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:22.609154 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:22.609601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:22.610020 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:22.623965 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] HTTP exception thrown: Instance e6d8882f-eb9d-4d78-817f-a8439224bba2 could not be found. Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Request method failure captured: Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 HTTP/1.1 Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nLjOJLBWBLqDcZGYCRgONufTBXc_RgELt6BLG3sFR9zduDM0ui2BUEHN3jOj5kHSVNNCsaZ4Grp1YXKhY0pb_XKCA-HxZkPjVQ8ecOhMRPtcrrooYOBvh1iMgHwKoRiJGOSZsAvfBJkhEx4zDTNGap8erGMW1ZClzm1dQNLEbkL1QY Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:19:22.625601 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c5e8eba08dfc4946becd6dba63f94eec", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: f9d0f858ee07466a90d9c1ecf2c18c19 Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance e6d8882f-eb9d-4d78-817f-a8439224bba2 could not be found. Aug 18 17:19:22.627330 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': 'e6d8882f-eb9d-4d78-817f-a8439224bba2'} Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e6d8882f-eb9d-4d78-817f-a8439224bba2 could not be found. Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:19:22.628418 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e6d8882f-eb9d-4d78-817f-a8439224bba2 could not be found. Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e6d8882f-eb9d-4d78-817f-a8439224bba2 could not be found. Aug 18 17:19:22.630081 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:22.631836 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Returning 404 to user: Instance e6d8882f-eb9d-4d78-817f-a8439224bba2 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:19:22.631836 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-30084703-9269-4f8b-913c-dd8a942a3f78 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2" status: 404 len: 111 microversion: 2.1 time: 0.031186 Aug 18 17:19:22.631836 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 619/1192] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:22 2022] GET /compute/v2.1/servers/e6d8882f-eb9d-4d78-817f-a8439224bba2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:19:26.384948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:26.385498 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:26.386650 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-477952f5-6b9f-4781-8bde-9a010b272015 req-11ed722e-383d-44af-90ed-11cf2e6253ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbe99c95-ce5b-467a-92d4-15b02ac57d02", "tag": "ae35b8e6-3767-4d67-8189-4241efe3de81"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:19:26.392305 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:26.393205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:26.393650 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:26.394750 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:26.394874 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:26.395222 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:26.398988 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-477952f5-6b9f-4781-8bde-9a010b272015 req-11ed722e-383d-44af-90ed-11cf2e6253ce service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:26.400253 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-477952f5-6b9f-4781-8bde-9a010b272015 req-11ed722e-383d-44af-90ed-11cf2e6253ce service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:26.400974 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-477952f5-6b9f-4781-8bde-9a010b272015 req-11ed722e-383d-44af-90ed-11cf2e6253ce service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:26.420386 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-477952f5-6b9f-4781-8bde-9a010b272015 req-11ed722e-383d-44af-90ed-11cf2e6253ce service nova] Creating event network-changed:ae35b8e6-3767-4d67-8189-4241efe3de81 for instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 on hv-cinder-85367 Aug 18 17:19:26.422805 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Going to try to terminate instance {{(pid=121268) delete /opt/stack/nova/nova/compute/api.py:2709}} Aug 18 17:19:26.429125 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-477952f5-6b9f-4781-8bde-9a010b272015 req-11ed722e-383d-44af-90ed-11cf2e6253ce service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045961 Aug 18 17:19:26.430300 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 620/1193] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:19:26.767957 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-8e09e088-e0a0-431e-b0db-f4482ad7380f tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "DELETE /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 204 len: 0 microversion: 2.1 time: 0.387387 Aug 18 17:19:26.768930 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 574/1194] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:19:26 2022] DELETE /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 18 17:19:26.777451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:26.778780 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:26.789149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:26.789149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:26.789149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:26.789149 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:26.789655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:26.789655 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:26.953674 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.policy [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121267) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:26.961848 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-c06c853a-2644-4121-a0b5-dbcda36d48f0 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1577 microversion: 2.1 time: 0.188623 Aug 18 17:19:26.962425 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 621/1195] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:26 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:27.984618 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:27.985324 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:27.992043 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:27.992534 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:27.992967 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:27.993669 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:27.994144 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:27.994598 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:28.131164 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:28.139900 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-d15ff771-cc33-4c53-a55a-515cffd1c144 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1458 microversion: 2.1 time: 0.159938 Aug 18 17:19:28.142790 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 575/1196] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:27 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:28.783217 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [req-92aab42e-362d-452d-9756-dfba1ebb17bb req-c27aaeff-d676-47f1-8aa6-ceefe43105f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbe99c95-ce5b-467a-92d4-15b02ac57d02", "name": "network-vif-deleted", "tag": "ae35b8e6-3767-4d67-8189-4241efe3de81"}]} {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 18 17:19:28.793165 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-92aab42e-362d-452d-9756-dfba1ebb17bb req-c27aaeff-d676-47f1-8aa6-ceefe43105f2 service nova] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:28.798769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-92aab42e-362d-452d-9756-dfba1ebb17bb req-c27aaeff-d676-47f1-8aa6-ceefe43105f2 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:28.798769 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [req-92aab42e-362d-452d-9756-dfba1ebb17bb req-c27aaeff-d676-47f1-8aa6-ceefe43105f2 service nova] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:28.805969 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.compute.server_external_events [req-92aab42e-362d-452d-9756-dfba1ebb17bb req-c27aaeff-d676-47f1-8aa6-ceefe43105f2 service nova] Creating event network-vif-deleted:ae35b8e6-3767-4d67-8189-4241efe3de81 for instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 on hv-cinder-85367 Aug 18 17:19:28.811777 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [req-92aab42e-362d-452d-9756-dfba1ebb17bb req-c27aaeff-d676-47f1-8aa6-ceefe43105f2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032349 Aug 18 17:19:28.812451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 622/1197] 10.222.0.78 () {64 vars in 1317 bytes} [Thu Aug 18 17:19:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 18 17:19:29.168151 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:29.168872 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:29.175999 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:29.176573 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:29.177077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:29.177874 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:29.178393 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:29.178886 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:29.241985 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.policy [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f9d0f858ee07466a90d9c1ecf2c18c19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5e8eba08dfc4946becd6dba63f94eec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121268) authorize /opt/stack/nova/nova/policy.py:199}} Aug 18 17:19:29.250689 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-54721bb9-da77-494d-935d-b69e23b0474c tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 200 len: 1224 microversion: 2.1 time: 0.093077 Aug 18 17:19:29.251260 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 576/1198] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:29 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 18 17:19:30.273013 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:30.273719 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: bbe99c95-ce5b-467a-92d4-15b02ac57d02] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:30.281019 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:30.281451 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:30.281888 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:30.282581 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:30.283043 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:30.283485 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:30.297303 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] HTTP exception thrown: Instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 could not be found. Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Request method failure captured: Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 HTTP/1.1 Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nLjOJLBWBLqDcZGYCRgONufTBXc_RgELt6BLG3sFR9zduDM0ui2BUEHN3jOj5kHSVNNCsaZ4Grp1YXKhY0pb_XKCA-HxZkPjVQ8ecOhMRPtcrrooYOBvh1iMgHwKoRiJGOSZsAvfBJkhEx4zDTNGap8erGMW1ZClzm1dQNLEbkL1QY Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:19:30.298921 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c5e8eba08dfc4946becd6dba63f94eec", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: f9d0f858ee07466a90d9c1ecf2c18c19 Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 could not be found. Aug 18 17:19:30.300695 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': 'bbe99c95-ce5b-467a-92d4-15b02ac57d02'} Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 could not be found. Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:19:30.301648 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 could not be found. Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 could not be found. Aug 18 17:19:30.302939 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.304173 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Returning 404 to user: Instance bbe99c95-ce5b-467a-92d4-15b02ac57d02 could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:19:30.304173 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-9c067003-56cd-4574-9fc7-a38cdc6fe84b tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02" status: 404 len: 111 microversion: 2.1 time: 0.031970 Aug 18 17:19:30.304173 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 623/1199] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:30 2022] GET /compute/v2.1/servers/bbe99c95-ce5b-467a-92d4-15b02ac57d02 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:19:30.850902 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:30.851405 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.compute.api [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121268) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:30.858077 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:30.858565 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:30.859021 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:30.859741 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:30.860205 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:30.860633 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG oslo_concurrency.lockutils [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121268) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:30.874939 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.wsgi [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] HTTP exception thrown: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Request method failure captured: Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: request: DELETE /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c HTTP/1.1 Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept: application/json Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Accept-Encoding: identity Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Connection: close Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Length: 0 Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Content-Type: application/json Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Host: 10.222.0.78 Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Openstack-System-Scope: None Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: User-Agent: python-urllib3/1.26.11 Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Auth-Token: gAAAAABi_nLjOJLBWBLqDcZGYCRgONufTBXc_RgELt6BLG3sFR9zduDM0ui2BUEHN3jOj5kHSVNNCsaZ4Grp1YXKhY0pb_XKCA-HxZkPjVQ8ecOhMRPtcrrooYOBvh1iMgHwKoRiJGOSZsAvfBJkhEx4zDTNGap8erGMW1ZClzm1dQNLEbkL1QY Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Id: None Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Domain-Name: None Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Identity-Status: Confirmed Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Is-Admin-Project: True Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Id: default Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Domain-Name: Default Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Project-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Role: reader,member Aug 18 17:19:30.876628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Roles: reader,member Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c5e8eba08dfc4946becd6dba63f94eec", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-Tenant-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Id: default Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Domain-Name: Default Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Id: f9d0f858ee07466a90d9c1ecf2c18c19 Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: X-User-Name: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: method: > Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: exception: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.878280 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: action_args: {'id': '7434d418-5586-4ce3-a420-21925506657c'} Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:19:30.879380 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.880964 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.882594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Returning 404 to user: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. {{(pid=121268) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:19:30.882594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-f53bcb7a-76fd-4cd6-b4c7-5e4cf50784d2 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 404 len: 111 microversion: 2.1 time: 0.031157 Aug 18 17:19:30.882594 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 577/1200] 10.222.0.78 () {58 vars in 1239 bytes} [Thu Aug 18 17:19:30 2022] DELETE /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 18 17:19:30.886541 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '>' {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:30.887792 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.compute.api [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] [instance: 7434d418-5586-4ce3-a420-21925506657c] Fetching instance by UUID {{(pid=121267) get /opt/stack/nova/nova/compute/api.py:2965}} Aug 18 17:19:30.893708 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:30.894190 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:30.894628 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:30.895323 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Acquiring lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 18 17:19:30.895919 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 18 17:19:30.896351 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG oslo_concurrency.lockutils [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Lock "d85d2796-38a5-4d76-99fb-481c052ce6b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121267) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 18 17:19:30.909943 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.wsgi [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] HTTP exception thrown: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Request method failure captured: Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: request: GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c HTTP/1.1 Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept: application/json Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Accept-Encoding: identity Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Connection: close Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Length: 0 Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Content-Type: application/json Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Host: 10.222.0.78 Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Openstack-System-Scope: None Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: User-Agent: python-urllib3/1.26.11 Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Auth-Token: gAAAAABi_nLjOJLBWBLqDcZGYCRgONufTBXc_RgELt6BLG3sFR9zduDM0ui2BUEHN3jOj5kHSVNNCsaZ4Grp1YXKhY0pb_XKCA-HxZkPjVQ8ecOhMRPtcrrooYOBvh1iMgHwKoRiJGOSZsAvfBJkhEx4zDTNGap8erGMW1ZClzm1dQNLEbkL1QY Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Id: None Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Domain-Name: None Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Identity-Status: Confirmed Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Is-Admin-Project: True Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Id: default Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Domain-Name: Default Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Project-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Role: reader,member Aug 18 17:19:30.911518 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Roles: reader,member Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/c5e8eba08dfc4946becd6dba63f94eec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:8080/v1/AUTH_c5e8eba08dfc4946becd6dba63f94eec", "adminURL": "http://10.222.0.78:8080"}]}] Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Id: c5e8eba08dfc4946becd6dba63f94eec Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-Tenant-Name: tempest-TestVolumeBootPattern-77034262 Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Id: default Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Domain-Name: Default Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Id: f9d0f858ee07466a90d9c1ecf2c18c19 Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: X-User-Name: tempest-TestVolumeBootPattern-77034262-project Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: method: > Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: exception: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.913215 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: action_args: {'id': '7434d418-5586-4ce3-a420-21925506657c'} Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: {{(pid=121267) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2968, in get Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2915, in _get_instance Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance_from_cell Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 18 17:19:30.914150 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. Aug 18 17:19:30.915703 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: ERROR nova.api.openstack.wsgi Aug 18 17:19:30.917203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: DEBUG nova.api.openstack.wsgi [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Returning 404 to user: Instance 7434d418-5586-4ce3-a420-21925506657c could not be found. {{(pid=121267) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 18 17:19:30.917203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO nova.api.openstack.requestlog [None req-3cf275cd-5a7a-4048-977a-b80dfc364feb tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c" status: 404 len: 111 microversion: 2.1 time: 0.030132 Aug 18 17:19:30.917203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: [pid: 121267|app: 0|req: 624/1201] 10.222.0.78 () {58 vars in 1236 bytes} [Thu Aug 18 17:19:30 2022] GET /compute/v2.1/servers/7434d418-5586-4ce3-a420-21925506657c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 18 17:19:32.500881 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: DEBUG nova.api.openstack.wsgi [None req-da28fcc1-f7fc-486a-bd80-ce087f0b4f32 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] Calling method '.version_select at 0x7ff5b5770040>' {{(pid=121268) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 18 17:19:32.653847 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO nova.api.openstack.requestlog [None req-da28fcc1-f7fc-486a-bd80-ce087f0b4f32 tempest-TestVolumeBootPattern-77034262 tempest-TestVolumeBootPattern-77034262-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-513148516" status: 202 len: 0 microversion: 2.1 time: 0.159822 Aug 18 17:19:32.654628 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: [pid: 121268|app: 0|req: 578/1202] 10.222.0.78 () {58 vars in 1260 bytes} [Thu Aug 18 17:19:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-513148516 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 18 17:20:31.303840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:20:31.304474 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Thu Aug 18 17:20:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:20:41.636316 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:20:41.636975 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Thu Aug 18 17:20:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:20:41.779775 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:20:41.780316 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Thu Aug 18 17:20:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:22:32.418536 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:22:32.419333 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Thu Aug 18 17:22:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:22:37.028514 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:22:37.029104 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Thu Aug 18 17:22:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:22:38.324099 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:22:38.324682 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Thu Aug 18 17:22:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:23:51.312203 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:23:51.312840 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Thu Aug 18 17:23:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:24:01.644553 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:24:01.645356 dv-cinder-853678-2-iscsi devstack@n-api.service[121267]: Thu Aug 18 17:24:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 18 17:24:01.790496 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 18 17:24:01.790948 dv-cinder-853678-2-iscsi devstack@n-api.service[121268]: Thu Aug 18 17:24:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!